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THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: 
SOME LIMITS ON OUR CAPACITY FOR 
PROCESSING INFORMATION * 


GEORGE A. MILLER 


Harvard University 


My problem is that I have been perse- 
cuted by an integer. For seven years 
this number has followed me around, has 
intruded in my most private data, and 
has assaulted me from the pages of our 
most public journals. This number as- 
sumes a variety of disguises, being some- 
times a little larger and sometimes a 
little smaller than usual, but never 
changing so much as to be unrecogniz- 
able. The persistence with which this 
number plagues me is far more than 
a random accident. There is, to quote 
a famous senator, a design behind it, 
some pattern governing its appearances. 
Either there really is something unusual 
about the number or else I am suffering 
from delusions of persecution. 

I shall begin my case history by tell- 
ing you about some experiments that 
tested how accurately people can assign 
numbers to the magnitudes of various 
aspects of a stimulus. In the tradi- 
tional language of psychology these 
would be called experiments in absolute 


1This paper was first read as an Invited 
Address before the Eastern Psychological As- 
sociation in Philadelphia on April 15, 1955. 
Preparation of the paper was supported by 
the Harvard Psycho-Acoustic Laboratory un- 
der Contract NSori-76 between Harvard Uni- 
versity and the Office of Naval Research, U. S. 
Navy (Project NR142-201, Report PNR-174). 
Reproduction for any purpose of the U. S. 
Government is permitted. 
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judgment. Historical accident, how- 
ever, has decreed that they should have 
another name. We now call them ex- 
periments on the capacity of people to 
transmit information. Since these ex- 
periments would not have been done 
without the appearance of information 
theory on the psychological scene, and 
since the results are analyzed in terms 
of the concepts of information theory, 
I shall have to preface my discussion 
with a few remarks about this theory. 


INFORMATION MEASUREMENT 


The “amount of information” is ex- 
actly the same concept that we have 
talked about for years under the name 
of “variance.” The equations are dif- 
ferent, but if we hold tight to the idea 
that anything that increases the vari- 
ance also increases the amount of infor- 
mation we cannot go far astray. 

The advantages of this new way 
of talking about variance are simple 
enough. Variance is always stated in 
terms of the unit of measurement— 
inches, pounds, volts, etc.—whereas the 
amount of information is a dimension- 
less quantity. Since the information in 
a discrete statistical distribution does 
not depend upon the unit of measure- 
ment, we can extend the concept to 
situations where we have no metric and 
we would not ordinarily think of using 
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the variance. And it also enables us to 
compare results obtained in quite dif- 
ferent experimental situations where it 
would be meaningless to compare vari- 
ances based on different metrics. So 
there are some good reasons for adopt- 
ing the newer concept. 

The similarity of variance and amount 
of information might be explained this 
way: When we have a large variance, 
we are very ignorant about what is go- 
ing to happen. If we are very ignorant, 
then when we make the observation it 
gives us a lot of information. On the 
other hand, if the variance is very small, 
we know in advance how our observa- 
tion must come out, so we get little in- 
formation from making the observation. 

If you will now imagine a communi- 
cation system, you will realize that 
there is a great deal of variability about 
what goes into the system and also a 
great deal of variability about what 
comes out. The input and the output 


can therefore be described in terms of 
their variance (or their information). 
If it is a good communication system, 
however, there must be some system- 
atic relation between what goes in and 


what comes out. That is to say, the 
output will depend upon the input, or 
will be correlated with the input. If we 
measure this correlation, then we can 
say how much of the output variance is 
attributable to the input and how much 
is due to random fluctuations or “noise” 
introduced by the system during trans- 
mission. So we see that the measure 
of transmitted information is simply a 
measure of the input-output correlation. 

There are two simple rules to follow. 
Whenever I refer to “amount of in- 
formation,” you will understand “vari- 
ance.” And whenever I refer to “amount 
of transmitted information,” you will 
understand “covariance” or “correla- 
tion.” 

The situation can be described graphi- 
cally by two partially overlapping cir- 


cles. Then the left circle can be taken 
to represent the variance of the input, 
the right circle the variance of the out- 
put, and the overlap the covariance of 
input and output. I shall speak of the 
left circle as the amount of input infor- 
mation, the right circle as the amount 
of output information, and the overlap 
as the amount of transmitted informa- 
tion. 

In the experiments on absolute judg- 
ment, the observer is considered to be 
a communication channel. Then the 
left circle would represent the amount 
of information in the stimuli, the right 
circle the amount of information in his 
responses, and the overlap the stimulus- 
response correlation as measured by the 
amount of transmitted information. The 
experimental problem is to increase the 
amount of input information and to 
measure the amount of transmitted in- 
formation. If the observer’s absolute 
judgments are quite accurate, then 
nearly all of the input information will 
be transmitted and will be recoverable 
from his responses. If he makes errors, 
then the transmitted information may 
be considerably less than the input. We 
expect that, as we increase the amount 
of input information, the observer will 
begin to make more and more errors; 
we can test the limits of accuracy of his 
absolute judgments. If the human ob- 
server is a reasonable kind of communi- 
cation system, then when we increase 
the amount of input information the 
transmitted information will increase at 
first and will eventually levcl off at some 
asymptotic value. This asymptotic value 
we take to be the channel capacity of 
the observer: it represents the greatest 
amount of information that he can give 
us about the stimulus on the basis of 
an absolute judgment. The channel ca- 
pacity is the upper limit on the extent 
to which the observer can match his re- 
sponses to the stimuli we give him. 

Now just a brief word about the Dit 
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and we can begin to look at some data. 
One bit of information is the amount of 
information that we need to make a 
decision between two equally likely al- 
ternatives. If we must decide whether 
a man is less than six feet tall or more 
than six feet tall and if we know that 
the chances are 50-50, then we need 
one bit of information. Notice that 
this unit of information does not refer 
in any way to the unit of length that 
we use—feet, inches, centimeters, etc. 
However you measure the man’s height, 
we still need just one bit of information. 

Two bits of information enable us to 
decide among four equally likely alter- 
natives. Three bits of information en- 
able us to decide among eight equally 
likely alternatives. Four bits of infor- 
mation decide among 16 alternatives, 
five among 32, and so on. That is to 
say, if there are 32 equally likely alter- 
natives, we must make five successive 


binary decisions, worth one bit each, be- 
fore we know which alternative is cor- 


rect. So the general rule is simple: 
every time the number of alternatives 
is increased by a factor of two, one bit 
of information is added. 

There are two ways we might in- 
crease the amount of input information. 
We could increase the rate at which we 
give information to the observer, so that 
the amount of information per unit time 
would increase. Or we could ignore the 
time variable completely and increase 
the amount of input information by 
increasing the number of alternative 
stimuli. In the absolute judgment ex- 
periment we are interested in the second 
alternative. We giv the observer as 
much time as he wants to make his re- 
sponse; we simply increase the number 
of alternative stimuli among which he 
must discriminate and look to see where 
confusions begin to occur. Confusions 
will appear near the point that we are 
calling his “channel capacity.” 


ABSOLUTE JUDGMENTS OF UNI- 
DIMENSIONAL STIMULI 


Now let us consider what happens 
when we make absolute judgments of 
tones. Pollack (17) asked listeners to 
identify tones by assigning numerals to 
them. The tones were different with re- 
spect to frequency, and covered the 
range from 100 to 8000 cps in equal 
logarithmic steps. A tone was sounded 
and the listener responded by giving a 
numeral. After the listener had made 
his response he was told the correct 
identification of the tone. 

When only two or three tones were 
used the listeners never confused them. 
With four different tones confusions 
were quite rare, but with five or more 
tones confusions were frequent. With 
fourteen different tones the listeners 
made many mistakes. 

These data are plotted in Fig. 1. 
Along the bottom is the amount of in- 
put information in bits per stimulus. 
As the number of alternative tones was 
increased from 2 to 14, the input infor- 
mation increased from 1 to 3.8 bits. On - 
the ordinate is plotted the amount of 





PITCHES 
100-8000 CPS 


TRANSMITTED INFORMATION 








1 


— 





INPUT INFORMATION 


Fic. 1. Data from Pollack (17, 18) on the 
amount of information that is transmitted by 
listeners who make absolute judgments of 
auditory pitch. As the amount of input in- 
formation is increased by increasing from 2 
to 14 the number of different pitches to be 
judged, the amount of transmitted informa- 
tion approaches as its upper limit a channel 
capacity of about 2.5 bits per judgment. 
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transmitted information. The amount 
of transmitted information behaves in 
much the way we would expect a com- 
munication channel to behave; the trans- 
mitted information increases linearly up 
to about 2 bits and then bends off to- 
ward an asymptote at about 2.5 bits. 
This value, 2.5 bits, therefore, is what 
we are calling the channel capacity of 
the listener for absolute judgments of 
pitch. 

So now we have the number 2.5 
bits. What does it mean? First, note 
that 2.5 bits corresponds to about six 
equally likely alternatives. The result 
means that we cannot pick more than 
six different pitches that the listener will 
never confuse. Or, stated slightly dif- 
ferently, no matter how many alterna- 
tive tones we ask him to judge, the best 
we can expect him to do is to assign 
them to about six different classes with- 
out error. Or, again, if we know that 
there were N alternative stimuli, then 


his judgment enables us to narrow down 
the particular stimulus to one out of 
N/6. 

Most people are surprised that the 


number is as small as six. Of course, 
there is evidence that a musically so- 
phisticated person with absolute pitch 
can identify accurately any one of 50 
or 60 different pitches. Fortunately, I 
do not have time to discuss these re- 
markable exceptions. I say it is for- 
tunate because I do not know how to 
explain their superior performance. So 
I shall stick to the more pedestrian fact 
that most of us can identify about one 
out of only five or six pitches before we 
begin to get confused. 

It is interesting to consider that psy- 
chologists have been using seven-point 
rating scales for a long time, on the 
intuitive basis that trying to rate into 
finer categories does not really add much 
to the usefulness of the ratings. Pol- 
lack’s results indicate that, at least for 
pitches, this intuition is fairly sound. 
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Fic. 2. Data from Garner (7) on the chan- 
nel capacity for absolute judgments of audi- 
tory loudness. 


Next you can ask how reproducible 
this result is. Does it depend on the 
spacing of the tones or the various con- 
ditions of judgment? Pollack varied 
these conditions in a number of ways. 
The range of frequencies can be changed 
by a factor of about 20 without chang- 
ing the amount of information trans- 
mitted more than a small percentage. 
Different groupings of the pitches de- 
creased the transmission, but the loss 
was small. For example, if you can 
discriminate five high-pitched tones in 
one series and five low-pitched tones in 
another series, it is reasonable to ex- 
pect that you could combine all ten into 
a single series and still tell them all 
apart without error. When you try it, 
however, it does not work. The chan- 
nel capacity for pitch seems to be about 
six and that is the best you can do. 

While we are on tones, let us look 
next at Garner’s (7) work on loudness. 
Garner’s data for loudness are sum- 
marized in Fig. 2. Garner went to some 
trouble to get the best possible spacing 
of his tones over the intensity range 
from 15 to 110 db. He used 4, 5, 6, 7, 
10, and 20 different stimulus intensities. 
The results shown in Fig. 2 take into 
account the differences among subjects 
and the sequential influence of the im- 
mediately preceding judgment. Again 
we find that there seems to be a limit. 
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Fic. 3. Data from Beebe-Center, Rogers, 
and O’Connell (1) on the channel capacity for 
absolute judgments of saltiness. 


The channel capacity for absolute judg- 
ments of loudness is 2.3 bits, or about 
five perfectly discriminable alternatives. 

Since these two studies were done in 
different laboratories with slightly dif- 
ferent techniques and methods of analy- 
sis, we are not in a good position to 
argue whether five loudnesses is signifi- 
cantly different from six pitches. Prob- 
ably the difference is in the right direc- 
tion, and absolute judgments of pitch 
are slightly more accurate than absolute 
judgments of loudness. The important 
point, however, is that the two answers 
are of the same order of magnitude. 

The experiment has also been done 
for taste intensities. In Fig. 3 are the 
results obtained by Beebe-Center, Rog- 
ers, and O’Connell (1) for absolute 
judgments of the concentration of salt 
solutions. The concentrations ranged 
from 0.3 to 34.7 gm. NaCl per 100 
cc. tap water in equal subjective steps. 
They used 3, 5, 9, and 17 different con- 
centrations. The channel capacity is 
1.9 bits, which is about four distinct 
concentrations. Thus taste intensities 
seem a little less distinctive than audi- 
tory stimuli, but again the order of 
magnitude is not far off. 

On the other hand, the channel ca- 
pacity for judgments of visual position 
seems to be significantly larger. Hake 


and Garner (8) asked observers to in- 
terpolate visually between two scale 
markers. Their results are shown in 
Fig. 4. They did the experiment in 
two ways. In one version they let the 
observer use any number between zero 
and 100 to describe the position, al- 
though they presented stimuli at only 
5, 10, 20, or 50 different positions. The 
results with this unlimited response 
technique are shown by the filled circles 
on the graph. In the other version the 
observers were limited in their re- 
sponses to reporting just those stimu- 
lus values that were possible. That is 
to say, in the second version the num- 
ber of different responses that the ob- 
server could make was exactly the same 
as the number of different stimuli that 
the experimenter might present. The 
results with this limited response tech- 
nique are shown by the open circles on 
the graph. The two functions are so 
similar that it seems fair to conclude 
that the number of responses available 
to the observer had nothing to do with 
the channel capacity of 3.25 bits. 

The Hake-Garner experiment has been 
repeated by Coonan and Klemmer. Al- 
though they have not yet published 
their results, they have given me per- 
mission to say that they obtained chan- 
nel capacities ranging from 3.2 bits for 
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Fic. 4. Data from Hake and Garner (8) 
on the channel capacity for absolute judg- 
ments of the position of a pointer in a linear 
interval. 
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very short exposures of the pointer po- 
sition to 3.9 bits for longer exposures. 
These values are slightly higher than 
Hake and Garner’s, so we must con- 
clude that there are between 10 and 15 
distinct positions along a linear inter- 
val. This is the largest channel ca- 
pacity that has been measured for any 
unidimensional variable. 

At the present time these four experi- 
ments on absolute judgments of simple, 
unidimensional stimuli are all that have 
appeared in the psychological journals. 
However, a great deal of work on other 
stimulus variables has not yet appeared 
in the journals. For example, Eriksen 
and Hake (6) have found that the 
channel capacity for judging the sizes 
of squares is 2.2 bits, or about five 
categories, under a wide range of ex- 
perimental conditions. In a separate 
experiment Eriksen (5) found 2.8 bits 
for size, 3.1 bits for hue, and 2.3 bits 
for brightness. Geldard has measured 


the channel capacity for the skin by 
placing vibrators on the chest region. 
A good observer can identify about four 
intensities, about five durations, and 
about seven locations. 

One of the most active groups in this 
area has been the Air Force Operational 


Applications Laboratory. Pollack has 
been kind enough to furnish me with 
the results of their measurements for 
several aspects of visual displays. They 
made measurements for area and for 
the curvature, length, and direction of 
lines. In one set of experiments they 
used a very short exposure of the stimu- 
lus—'49 second—and then they re- 
peated the measurements with a 5- 
second exposure. For area they got 
2.6 bits with the short exposure and 
2.7 bits with the long exposure. For 
the length of a line they got about 2.6 
bits with the short exposure and about 
3.0 bits with the long exposure. Direc- 
tion, or angle of inclination, gave 2.8 


bits for the short exposure and 3.3 bits ° 


for the long exposure. Curvature was 
apparently harder to judge. When the 
length of the arc was constant, the re- 
sult at the short exposure duration was 
2.2 bits, but when the length of the 
chord was constant, the result was only 
1.6 bits. This last value is the lowest 
that anyone has measured to date. I 
should add, however, that these values 
are apt to be slightly too low because 
the data from all subjects were pooled 
before the transmitted information was 
computed. 

Now let us see where we are. First, 
the channel capacity does seem to be a 
valid notion for describing human ob- 
servers. Second, the channel capacities 
measured for these unidimensional vari- 
ables range from 1.6 bits for curvature 
to 3.9 bits for positions in an interval. 
Although there is no question that the 
differences among the variables are real 
and meaningful, the more impressive 
fact to me is their considerable simi- 
larity. If I take the best estimates I 
can get of the channel capacities for all 
the stimulus variables I have mentioned, 
the mean is 2.6 bits and the standard 
deviation is only 0.6 bit. In terms of 
distinguishable alternatives, this mean 
corresponds to about 6.5 categories, one 
standard deviation includes from 4 to 
10 categories, and the total range is 
from 3 to 15 categories. Considering 
the wide variety of different variables 
that have been studied, I find this to 
be a remarkably narrow range. 

There seems to be some limitation 
built into us either by learning or by 
the design of our nervous systems, a 
limit that keeps our channel capacities 
in this general range. On the basis of 
the present evidence it seems safe to 
say that we possess a finite and rather 
small capacity for making such unidi- 
mensional judgments and that this ca- 
pacity does not vary a great deal from 
one simple sensory attribute to another. 





THe Macicat NUMBER SEVEN 87 


ABSOLUTE JUDGMENTS OF MULTI- 
DIMENSIONAL STIMULI 


You may have noticed that I have 
been careful to say that this magical 
number seven applies to one-dimensional 
judgments. Everyday experience teaches 
us that we can identify accurately any 
one of several hundred faces, any one 
of several thousand words, any one of 
several thousand objects, etc. The story 
certainly would not be complete if we 
stopped at this point. We must have 
some understanding of why the one- 
dimensional variables we judge in the 
laboratory give results so far out of 
line with what we do constantly in our 
behavior outside the laboratory. A pos- 
sible explanation lies in the number of 
independently variable attributes of the 
stimuli that are being judged. Objects, 
faces, words, and the like differ from 
one another in many ways, whereas the 
simple stimuli we have considered thus 


far differ from one another in only one 
respect. 

Fortunately, there are a few data on 
what happens when we make absolute 
judgments of stimuli that differ from 


one another in several ways. Let us 
look first at the results Klemmer and 
Frick (13) have reported for the abso- 
lute judgment of the position of a dot 
in a square. In Fig. 5 we see their re- 
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Fic. 5. Data from Klemmer and Frick (13) 
on the channel capacity for absolute judg- 
ments of the position of a dot in a square. 
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sults. Now the channel capacity seems 
to have increased to 4.6 bits, which 
means that people can identify accu- 
rately any one of 24 positions in the 
square. 

The position of a dot in a square is 
clearly a two-dimensional proposition. 
Both its horizontal and its vertical po- 
sition must be identified. Thus it seems 
natural to compare the 4.6-bit capacity 
for a square with the 3.25-bit capacity 
for the position of a point in an inter- 
val. The point in the square requires 
two judgments of the interval type. If 
we have a capacity of 3.25 bits for esti- 
mating intervals and we do this twice, 
we should get 6.5 bits as our capacity 
for locating points in a square. Adding 
the second independent dimensicn gives 
us an increase from 3.25 to 4.6, but it 
falls short of the perfect addition that 
would give 6.5 bits. 

Another example is provided by Beebe- 
Center, Rogers, and O’Connell. When 
they asked people to identify both the 
saltiness and the sweetness of solutions 
containing various concentrations of salt 
and sucrose, they found that the chan- 
nel capacity was 2.3 bits. Since the ca- 
pacity for salt alone was 1.9, we might 
expect about 3.8 bits if the two aspects 
of the compound stimuli were judged 
independently. As with spatial loca- 
tions, the second dimension adds a little 
to the capacity but not as much as it 
conceivably might. 

A third example is provided by Pol- 
lack (18), who asked listeners to judge 
both the loudness and the pitch of pure 
tones. Since pitch gives 2.5 bits and 
loudness gives 2.3 bits, we might hope 
to get as much as 4.8 bits for pitch and 
loudness together. Pollack obtained 3.1 
bits, which again indicates that the 
second dimension augments the channel 
capacity but not so much as it might. 

A fourth example can be drawn from 
the work of Halsey and Chapanis (9) 
on confusions among colors of equal 
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luminance. Although they did not ana- 
lyze their results in informational terms, 
they estimate that there are about 11 to 
15 identifiable colors, or, in our terms, 
about 3.6 bits. Since these colors varied 
in both hue and saturation, it is prob- 
ably correct to regard this as a two- 
dimensional judgment. If we compare 
this with Eriksen’s 3.1 bits for hue 
(which is a questionable comparison to 
draw), we again have something less 
than perfect addition when a second 
dimension is added. 

It is still a long way, however, from 
these two-dimensional examples to the 
multidimensional stimuli provided by 
faces, words, etc. To fill this gap we 
have only one experiment, an auditory 
study done by Pollack and Ficks (19). 
They managed to get six different acous- 
tic variables that they could change: 
frequency, intensity, rate of interrup- 
tion, on-time fraction, total duration, 
and spatial location. Each one of these 
six variables could assume any one of 
five different values, so altogether there 
were 5°, or 15,625 different tones that 
they could present. The listeners made 
a separate rating for each one of these 
six dimensions. Under these conditions 
the transmitted information was 7.2 bits, 
which corresponds to about 150 differ- 
ent categories that could be absolutely 
identified without error. Now we are 
beginning to get up into the range that 
ordinary experience would lead us to 
expect. 

Suppose that we plot these data, 
fragmentary as they are, and make a 
guess about how the channel capacity 
changes with the dimensionality of the 
stimuli. The result is given in Fig. 6. 
In a moment of considerable daring I 
sketched the dotted line to indicate 
roughly the trend that the data seemed 
to be taking. 

Clearly, the addition of independently 
variable attributes to the stimulus in- 
creases the channel capacity, but at a 
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Fic. 6. The general form of the relation be- 
tween channel capacity and the number of in- 
dependently variable attributes of the stimuli. 


decreasing rate. It is interesting to 
note that the channel capacity is in- 
creased even when the several variables 
are not independent. Eriksen (5) re- 
ports that, when size, brightness, and 
hue all vary together in perfect correla- 
tion, the transmitted information is 4.1 
bits as compared with an average of 
about 2.7 bits when these attributes are 
varied one at a time. By confounding 
three attributes, Eriksen increased the 
dimensionality of the input without in- 
creasing the amount of input informa- 
tion; the result was an increase in chan- 
nel capacity of about the amount that 
the dotted function in Fig. 6 would lead 
us to expect. 

The point seems to be that, as we 
add more variables to the display, we 
increase the total capacity, but we de- 
crease the accuracy for any particular 
variable. In other words, we can make 
relatively crude judgments of several 
things simultaneously. 

We might argue that in the course of 
evolution those organisms were most 
successful that were responsive to the 
widest range of stimulus energies in 
their environment. In order to survive 
in a constantly fluctuating world, it was 
better to have a little information about 
a lot of things than to have a lot of in- 
formation about a small segment of the 














environment. If a compromise was nec- 
essary, the one we seem to have made is 
clearly the more adaptive. 

Pollack and Ficks’s results are very 
strongly suggestive of an argument that 
linguists and phoneticians have been 
making for some time (11). According 
to the linguistic analysis of the sounds 
of human speech, there are about eight 
or ten dimensions—the linguists call 
them distinctive features—that distin- 
guish one phoneme from another. These 
distinctive features are usually binary, 
or at most ternary, in nature. For ex- 
ample, a binary distinction is made be- 
tween vowels and consonants, a binary 
decision is made between oral and nasal 
consonants, a ternary decision is made 
among front, middle, and back pho- 
nemes, etc. This approach gives us 
quite a different picture of speech per- 
ception than we might otherwise obtain 
from our studies of the speech spectrum 
and of the ear’s ability to discriminate 
relative differences among pure tones. 
I am personally much interested in this 
new approach (15), and I regret that 
there is not time to discuss it here. 

It was probably with this linguistic 
theory in mind that Pollack and Ficks 
conducted a test on a set of tonal 
stimuli that varied in eight dimensions, 
but required only a binary decision on 
each dimension. With these tones they 
measured the transmitted information 
at 6.9 bits, or about 120 recognizable 
kinds of sounds. It is an intriguing 
question, as yet unexplored, whether 
one can go on adding dimensions in- 
definitely in this way. 

In human speech there is clearly a 
limit to the number of dimensions that 
we use. In this instance, however, it is 
not known whether the limit is imposed 
by the nature of the perceptual ma- 
chinery that must recognize the sounds 
or by the nature of the speech ma- 
chinery that must produce them. Some- 
body will have to do the experiment to 
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find out. There is a limit, however, at 
about eight or nine distinctive features 
in every language that has been studied, 
and so when we talk we must resort to 
still another trick for increasing our 
channel capacity. Language uses se- 
quences of phonemes, so we make sev- 
eral judgments successively when we 
listen to words and sentences. That is 
to say, we use both simultaneous and 
successive discriminations in order to 
expand the rather rigid limits imposed 
by the inaccuracy of our absolute judg- 
ments of simple magnitudes. 

These multidimensional judgments are 
strongly reminiscent of the abstraction 
experiment of Kiilpe (14). As you may 
remember, Kiilpe showed that observers 
report more accurately on an attribute 
for which they are set than on attributes 
for which they are not set. For exam- 
ple, Chapman (4) used three different 
attributes and compared the results ob- 
tained when the observers were in- 
structed before the tachistoscopic pres- 
entation with the results obtained when 
they were not told until after the pres- 
entation which one of the three attri- 
butes was to be reported. When the 
instruction was given in advance, the 
judgments were more accurate. When 
the instruction was given afterwards, 
the subjects presumably had to judge all 
three attributes in order to report on 
any one of them and the accuracy was 
correspondingly lower. This is in com- 
plete accord with the results we have 
just been considering, where the ac- 
curacy of judgment on each attribute 
decreased as more dimensions were 
added. The point is probably obvious, 
but I shall make it anyhow, that the 
abstraction experiments did mot demon- 
strate that people can judge only one 
attribute at a time. They merely showed 
what seems quite reasonable, that peo- 
ple are less accurate if they must judge 
more than one attribute simultaneously. 
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SUBITIZING 


I cannot leave this general area with- 
out mentioning, however briefly, the ex- 
periments conducted at Mount Holyoke 
College on the discrimination of num- 
ber (12). In experiments by Kaufman, 
Lord, Reese, and Volkmann random 
patterns of dots were flashed on a screen 
for 4% of a second. Anywhere from 1 
to more than 200 dots could appear in 
the pattern. The subject’s task was to 
report how many dots there were. 

The first point to note is that on pat- 
terns containing up to five or six dots 
the subjects simply did not make errors. 
The performance on these small num- 
bers of dots was so different from the 
performance with more dots that it was 
given a special name. Below seven the 
subjects were said to subitize; above 
seven they were said to estimate. This 
is, as you will recognize, what we once 
optimistically called “the span of atten- 
tion.” 


This discontinuity at seven is, of 


course, suggestive. Is this the same 
basic process that limits our unidimen- 
sional judgments to about seven cate- 
gories? The generalization is tempting, 
but not sound in my opinion. The data 
on number estimates have not been ana- 
lyzed in informational terms; but on 
the basis of the published data I would 
guess that the subjects transmitted 
something more than four bits of in- 
formation about the number of dots. 
Using the same arguments as before, we 
would conclude that there are about 20 
or 30 distinguishable categories of nu- 
merousness. This is considerably more 
information than we would expect to 
get from a unidimensional display. It 
is, as a matter of fact, very much like a 
two-dimensional display. Although the 
dimensionality of the random dot pat- 
terns is not entirely clear, these results 
are in the same range as Klemmer and 
Frick’s for their two-dimensional dis- 
play of dots in a square. Perhaps the 


two dimensions of numerousness are 
area and density. When the subject 
can subitize, area and density may not 
be the significant variables, but when 
the subject must estimate perhaps they 
are significant. In any event, the com- 
parison is not so simple as it might 
seem at first thought. 

This is one of the ways in which the 
magical number seven has persecuted 
me. Here we have two closely related 
kinds of experiments, both of which 
point to the significance of the number 
seven as a limit on our capacities. And 
yet when we examine the matter more 
closely, there seems to be a reasonable 
suspicion that it is nothing more than 
a coincidence. 


Tue SPAN OF IMMEDIATE MEMORY 


Let me summarize the situation in 
this way. There is a clear and definite 
limit to the accuracy with which we can 
identify absolutely the magnitude of 
a unidimensional stimulus variable. I 
would propose to call this limit the 
span of absolute judgment, and I 
maintain that for unidimensional judg- 
ments this span is usually somewhere 
in the neighborhood of seven. We are 
not completely at the mercy of this 
limited span, however, because we have 
a variety of techniques for getting 
around it and increasing the accuracy 
of our judgments. The three most im- 
portant of these devices are (a) to 
make relative rather than absolute judg- 
ments; or, if that is not possible, (5) 
to increase the number of dimensions 
along which the stimuli can differ; or 
(c) to arrange the task in such a way 
that we make a sequence of several ab- 
solute judgments in a row. 

The study of relative judgments is 
one of the oldest topics in experimental 
psychology, and I will not pause to re- 
view it now. The second device, in- 
creasing the dimensionality, we have just 
considered. It seems that by adding 
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more dimensions and requiring crude, 
binary, yes-no judgments on each at- 
tribute we can extend the span of abso- 
lute judgment from seven to at least 
150. Judging from our everyday be- 
havior, the limit is probably in the 
thousands, if indeed there is a limit. In 
my opinion, we cannot go on compound- 
ing dimensions indefinitely. I suspect 
that there is also a span of perceptual 
dimensionality and that this span is 
somewhere in the neighborhood of ten, 
but I must add at once that there is no 
objective evidence to support this sus- 
picion. This is a question sadly need- 
ing experimental exploration. 
Concerning the third device, the use 
of successive judgments, I have quite a 
bit to say because this device introduces 
memory as the handmaiden of discrimi- 
nation. And, since mnemonic processes 


are at least as complex as are perceptual 
processes, we can anticipate that their 
interactions will not be easily disen- 


tangled. 

Suppose that we start by simply ex- 
tending slightly the experimental pro- 
cedure that we have been using. Up 
to this point we have presented a single 
stimulus and asked the observer to name 
it immediately thereafter. We can ex- 
tend this procedure by requiring the ob- 
server to withhold his response until we 
have given him several stimuli in suc- 
cession. At the end of the sequence of 
stimuli he then makes his response. We 
still have the same sort of input-out- 
put situation that is required for the 
measurement of transmitted informa- 
tion. But now we have passed from 
an experiment on absolute judgment to 
what is traditionally called an experi- 
ment on immediate memory. 

Before we look at any data on this 
topic I feel I must give you a word of 
warning to help you avoid some obvi- 
ous associations that can be confusing. 
Everybody knows that there is a finite 
span of immediate memory and that for 


a lot of different kinds of test materials 
this span is about seven items in length. 
I have just shown you that there is a 
span of absolute judgment that can dis- 
tinguish about seven categories and that 
there is a span of attention that will 
encompass about six objects at a glance. 
What is more natural than to think that 
all three of these spans are different as- 
pects of a single underlying process? 
And that is a fundamental mistake, as 
I shall be at some pains to demonstrate. 
This mistake is one of the malicious 
persecutions that the magical number 
seven has subjected me to. 

My mistake went something like this. 
We have seen that the invariant fea- 
ture in the span of absolute judgment 
is the amount of information that the 
observer can transmit. There is a real 
operational similarity between the ab- 
solute judgment experiment and the 
immediate memory experiment. If im- 
mediate memory is like absolute judg- 
ment, then it should follow that the in- 
variant feature in the span of immediate 
memory is also the amount of informa- 
tion that an observer can retain. If the 
amount of information in the span of 
immediate memory is a constant, then 
the span should be short when the indi- 
vidual items contain a lot of informa- 
tion and the span should be long when 
the items contain little information. For 
example, decimal digits are worth 3.3 
bits apiece. We can recall about seven 
of them, for a total of 23 bits of in- 
formation. Isolated English words are 
worth about 10 bits apiece. If the total 
amount of information is to remain 
constant at 23 bits, then we should be 
able to remember only two or three 
words chosen at random. In this way 
I generated a theory about how the span 
of immediate memory should vary as a 
function of the amount of information 
per item in the test materials. 

The measurements of memory span in 
the literature are suggestive on this 
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question, but not definitive. And so it 
was necessary to do the experiment to 
see. Hayes (10) tried it out with five 
different kinds of test materials: binary 
digits, decimal digits, letters of the al- 
phabet, letters plus decimal digits, and 
with 1,000 monosyllabic words. The 
lists were read aloud at the rate of one 
item per second and the subjects had as 
much time as they needed to give their 
responses. A procedure described by 
Woodworth (20) was used to score the 
responses. 

The results are shown by the filled 
circles in Fig. 7. Here the dotted line 
indicates what the span should have 
been if the amount of information in the 
span were constant. The solid curves 
represent the data. Hayes repeated the 
experiment using test vocabularies of 
different sizes but all containing only 
English monosyllables (open circles in 
Fig. 7). This more homogeneous test 
material did not change the picture sig- 
nificantly. With binary items the span 
is about nine and, although it drops to 
about five with monosyllabic English 
words, the difference is far less than 
the hypothesis of constant information 
would require. 
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Fic. 7. Data from Hayes (10) on the span 
of immediate memory plotted as a function 
of the amount of information per item in the 
test materials. 
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Fic. 8. Data from Pollack (16) on the 
amount of information retained after one 
presentation plotted as a function of the 
amount of information per item in the test 
materials. 


There is nothing wrong with Hayes’s 
experiment, because Pollack (16) re- 
peated it much more elaborately and 
got essentially the same result. Pol- 
lack took pains to measure the amount 
of information transmitted and did not 
rely on the traditional procedure for 
scoring the responses. His results are 
plotted in Fig. 8. Here it is clear that 
the amount of information transmitted 
is not a constant, but increases almost 
linearly as the amount of information 
per item in the input is increased. 

And so the outcome is perfectly clear. 
In spite of the coincidence that the 
magical number seven appears in both 
places, the span of absolute judgment 
and the span of immediate memory are 
quite different kinds of limitations that 
are imposed on our ability to process 
information. Absolute judgment is lim- 
ited by the amount of information. Im- 
mediate memory is limited by the num- 
ber of items. In order to capture this dis- 
tinction in somewhat picturesque terms, 
I have fallen into the custom of distin- 
guishing between bits of information 
and chunks of information. Then I can 
say that the number of bits of informa- 
tion is constant for absolute judgment 
and the number of chunks of informa- 
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tion is constant for immediate memory. 
The span of immediate memory seems 
to be almost independent of the number 
of bits per chunk, at least over the 
range that has been examined to date. 

The contrast of the terms bit and 
chunk also serves to highlight the fact 
that we are not very definite about what 
constitutes a chunk of information. For 
example, the memory span of five words 
that Hayes obtained when each word 
was drawn at random from a set of 1000 
English monosyllables might just as ap- 
propriately have been called a memory 
span of 15 phonemes, since each word 
had about three phonemes in it. Intui- 
tively, it is clear that the subjects were 
recalling five words, not 15 phonemes, 
but the logical distinction is not im- 
mediately apparent. We are dealing 
here with a process of organizing or 
grouping the input into familiar units 
or chunks, and a great deal of learning 
has gone into the formation of these 
familiar units. 


RECODING 


In order to speak more precisely, 
therefore, we must recognize the impor- 
tance of grouping or organizing the in- 
put sequence into units or chunks. 
Since the memory span is a fixed num- 
ber of chunks, we can increase the num- 
ber of bits of information that it con- 
tains simply by building larger and 
larger chunks, each chunk containing 
more information than before. 

A man just beginning to learn radio- 
telegraphic code hears each dit and dah 
as a separate chunk. Soon he is able 
to organize these sounds into letters and 
then he can deal with the letters as 
chunks. Then the letters organize 
themselves as words, which are still 
larger chunks, and he begins to hear 
whole phrases. I do not mean that each 
step is a discrete process, or that pla- 
teaus must appear in his learning curve, 
for surely the levels of organization are 


achieved at different rates and overlap 
each other during the learning process. 
I am simply pointing to the obvious 
fact that the dits and dahs are organ- 
ized by learning into patterns and that 
as these larger chunks emerge the 
amount of message that the operator 
can remember increases correspondingly. 
In the terms I am proposing to use, the 
operator learns to increase the bits per 
chunk. 

In the jargon of communication the- 
ory, this process would be called recod- 
ing. The input is given in a code that 
contains many chunks with few bits per 
chunk. The operator recodes the input 
into another code that contains fewer 
chunks with more bits per chunk. There 
are many ways to do this recoding, but 
probably the simplest is to group the 
input events, apply a new name to the 
group, and then remember the new name 
rather than the original input events. 

Since I am convinced that this proc- 
ess is a very general and important one 
for psychology, I want to tell you about 
a demonstration experiment that should 
make perfectly explicit what I am talk- 
ing about. This experiment was con- 
ducted by Sidney Smith and was re- 
ported by him before the Eastern Psy- 
chological Association in 1954. 

Begin with the observed fact that peo- 
ple can repeat back eight decimal digits, 
but only nine binary digits. Since there 
is a large discrepancy in the amount of 
information recalled in these two cases, 
we suspect at once that a recoding pro- 
cedure could be used to increase the 
span of immediate memory for binary 
digits. In Table 1 a method for group- 
ing and renaming is illustrated. Along 
the top is a sequence of 18 binary digits, 
far more than any subject was able to 
recall after a single presentation. In 
the next line these same binary digits 
are grouped by pairs. Four possible 
pairs can occur: 00 is renamed 0, 01 is 
renamed 1, 10 is renamed 2, and 11 is 
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TABLE 1 


Ways oF RECODING SEQUENCES OF BrnAry DiciTs 





Binary Digits (Bits) 1 


010001 


7@2 229 04 





2:1 Chunks 10 10 
Recoding 2 2 


3:1 Chunks 101 
Recoding 5 


4:1 Chunks 1010 
Recoding 10 


5:1 Chunks 10100 
Recoding 20 


00 10 O1 ii! 


0 2 1 3 0 


000 100 111 001 


+ 7 1 


0010 0111 0011 
2 7 3 


01001 11001 
9 25 





renamed 3. That is to say, we recode 
from a base-two arithmetic to a base- 
four arithmetic. In the recoded  se- 
quence there are now just nine digits to 
remember, and this is almost within the 
span of immediate memory. In the next 
line the same sequence of binary digits 
is regrouped into chunks of three. There 
are eight possible sequences of three, so 


we give each sequence a new name be- 


tween 0 and 7. Now we have recoded 
from a sequence of 18 binary digits 
into a sequence of 6 octal digits, and 
this is well within the span of immedi- 
ate memory. In the last two lines the 
binary digits are grouped by fours and 
by fives and are given decimal-digit 
names from 0 to 15 and from 0 to 31. 

It is reasonably obvious that this kind 
of recoding increases the bits per chunk, 
and packages the binary sequence into 
a form that can be retained within the 
span of immediate memory. So Smith 
assembled 20 subjects and measured 
their spans for binary and octal digits. 
The spans were 9 for binaries and 7 for 
octals. Then he gave each recoding 
scheme to five of the subjects. They 
studied the recoding until they said 
they understood it—for about 5 or 10 
minutes. Then he tested their span for 
binary digits again while they tried to 
use the recoding schemes they had 
studied. 


The recoding schemes increased their 
span for binary digits in every case. 
But the increase was not as large as we 
had expected on the basis of their span 
for octal digits. Since the discrepancy 
increased as the recoding ratio increased, 
we reasoned that the few minutes the 
subjects had spent learning the recod- 
ing schemes had not been sufficient. 
Apparently the translation from one 
code to the other must be almost auto- 
matic or the subject will lose part of the 
next group while he is trying to remem- 
ber the translation of the last group. 

Since the 4:1 and 5:1 ratios require 
considerable study, Smith decided to 
imitate Ebbinghaus and do the experi- 
ment on himself. With Germanic pa- 
tience he drilled himself on each recod- 
ing successively, and obtained the re- 
sults shown in Fig. 9. Here the data 
follow along rather nicely with the re- 
sults you would predict on the basis of 
his span for octal digits. He could re- 
member 12 octal digits. With the 2:1 
recoding, these 12 chunks were worth 
24 binary digits. With the 3:1 recod- 
ing they were worth 36 binary digits. 
With the 4:1 and 5:1 recodings, they 
were worth about 40 binary digits. 

It is a little dramatic to watch a per- 
son get 40 binary digits in a row and 
then repeat them back without error. 
However, if you think of this merely as 
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OBSERVED 











MEMORY SPAN FOR BINARY DIGITS 





5:1 


RECODING RATIO 


Fic. 9. The span of immediate memory for 
binary digits is plotted as a function of the 
recoding procedure used. The predicted func- 
tion is obtained by multiplying the span for 
octals by 2, 3 and 3.3 for recoding into base 
4, base 8, and base 10, respectively. 


a mnemonic trick for extending the 
memory span, you will miss the more 
important point that is implicit in 
nearly all such mnemonic devices. The 
point is that recoding is an extremely 
powerful weapon for increasing the 
amount of information that we can 
deal with. In one form or another we 
use recoding constantly in our daily 
behavior. 

In my opinion the most customary 
kind of recoding that we do all the time 
is to translate into a verbal code. When 
there is a story or an argument or an 
idea that we want to remember, we usu- 
ally try to rephrase it “in our own 
words.” When we witness some event 
we want to remember, we make a verbal 
description of the event and then re- 
member our verbalization. Upon recall 
we recreate by secondary elaboration 
the details that seem consistent with 
the particular verbal recoding we hap- 
pen to have made. The well-known ex- 
periment by Carmichael, Hogan, and 
Walter (3) on the influence that names 
have on the recall of visual figures is 
one demonstration of the process. 

The inaccuracy of the testimony of 


eyewitnesses is well known in legal psy- 
chology, but the distortions of testi- 
mony are not random—they follow 
naturally from the particular recoding 
that the witness used, and the particu- 
lar recoding he used depends upon his 
whole life history. Our language is tre- 
mendously useful for repackaging ma- 
terial into a few chunks rich in infor- 
mation. I suspect that imagery is a 
form of recoding, too, but images seem 
much harder to get at operationally and 
to study experimentally than the more 
symbolic kinds of recoding. 

It seems probable that even memori- 
zation can be studied in these terms. 
The process of memorizing may be sim- 
ply the formation of chunks, or groups 
of items that go together, until there 
are few enough chunks so that we can 
recall all the items. The work by Bous- 
field and Cohen (2) on the occurrence 
of clustering in the recall of words is 
especially interesting in this respect. 


SUMMARY 


I have come to the end of the data 
that I wanted to present, so I would 
like now to make some summarizing re- 
marks. 

First, the span of absolute judgment 
and the span of immediate memory im- 
pose severe limitations on the amount 
of information that we are able to re- 
ceive, process, and remember. By or- 
ganizing the stimulus input simultane- 
ously into several dimensions and suc- 
cessively into a sequence of chunks, we 
manage to break (or at least stretch) 
this informational bottleneck. 

Second, the process of recoding is a 
very important one in human psychol- 
ogy and deserves much more explicit at- 
tention than it has received. In par- 
ticular, the kind of linguistic recoding 
that people do seems to me to be the 
very lifeblood of the thought processes. 
Recoding procedures are a constant 
concern to clinicians, social psycholo- 
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gists, linguists, and anthropologists and 
yet, probably because recoding is less 
accessible to experimental manipulation 
than nonsense syllables or T mazes, the 
traditional experimental psychologist has 
contributed little or nothing to their 
analysis. Nevertheless, experimental 
techniques can be used, methods of re- 
coding can be specified, behavioral in- 
dicants can be found. And I anticipate 
that we will find a very orderly set of 
relations describing what now seems an 
uncharted wilderness of individual dif- 
ferences. 

Third, the concepts and measures 
provided by the theory of information 
provide a quantitative way of getting at 
some of these questions. The theory 
provides us with a yardstick for cali- 
brating our stimulus materials and for 
measuring the performance of our sub- 
jects. In the interests of communica- 
tion I have suppressed the technical de- 
tails of information measurement and 


have tried to express the ideas in more 
familiar terms; I hope this paraphrase 
will not lead you to think they are not 


useful in research. Informational con- 
cepts have already proved valuable in 
the study of discrimination and of lan- 
guage; they promise a great deal in the 
study of learning and memory; and it 
has even been proposed that they can 
be useful in the study of concept for- 
mation. A lot of questions that seemed 
fruitless twenty or thirty years ago may 
now be worth another look. In fact, I 
feel that my story here must stop just 
as it begins to get really interesting. 
And finally, what about the magical 
number seven? What about the seven 
wonders of the world, the seven seas, 
the seven deadly sins, the seven daugh- 
ters of Atlas in the Pleiades, the seven 
ages of man, the seven levels of hell, 
the seven primary colors, the seven notes 
of the musical scale, and the seven days 
of the week? What about the seven- 
point rating scale, the seven categories 


for absolute judgment, the seven ob- 
jects in the span of attention, and the 
seven digits in the span of immediate 
memory? For the present I propose to 
withhold judgment. Perhaps there is 
something deep and profound behind all 
these sevens, something just calling out 
for us to discover it. But I suspect 
that it is only a pernicious, Pythagorean 
coincidence. 
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This paper is an inquiry into the 
methodology of confirming theories in 
psychology. By theory we shall mean 
any empirical generalization—a hypothe- 
sis, a law, a postulate, etc. The pro- 
cedure currently used for testing theories 
is known as inference by confirmation, 
which is an invalid procedure. To illus- 
trate the fallacy involved, consider a 
simple statement of a theory: a> b; 
for example, let a stand for the proposi- 
tion, “an industrial work group is in 
great inner conflict,” and 6 for “that 
work group has a low production level.” 
The formula may then be interpreted 
thus: “if an industrial work group is in 
great inner conflict, ‘hen that work group 
has a low production level.” Normally, 
to test this theory we would measure the 
work output of such a group. If we 
find that it is low, compared to a control 
group, we would assert the consequent 
of the theory, that is, b. A probability 
inference from 6 to the theory, a_ 3, 
would then be made and the conclusion 
would be reached that the probability 
of the theory is increased. However, 
when the consequent is found to be true, 
it does not follow that the probability of 
the theory is increased; alternative 
theories of psychology may also imply 
b; for example, a’ > 6b, a’’ > b, and so on 
(cf. 2). As Reichenbach (12) shows, 
when it seems that a theory is confirmed 
strictly by its consequents, more is really 


1 Now at Hollins College. 

2 The author is indebted to W. Battrick, R. 
Carnap, J. E. Freund, F. George, E. F. Mac- 
Caslin, P. Oppenheim, and W. Salmon, for 
criticizing earlier drafts of this paper, although 
they are not responsible for its final form. 

*The symbol “>” is the notation for the 
logical operation of implication and may be 
ka ee ea 
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known than is explicitly stated; other 
probabilities, to be discussed later, are 
necessary for a valid inference. 

This fallacy has been variously pointed 
out by psychologists. For example, 
Miller says that Hull “. . . is wrong in 
saying that . . . postulates can receive 
indirect verification . . . [for] two in- 
correct postulates in a system may give 
rise to a correct conclusion which is 
directly verifiable. . . .” He adds that 
one cannot argue from observed con- 
clusions to a proof of premises, for this 
is the “fallacy of affirming the conse- 
quent” (11, p. 468). Similarly, Johnson 
says: 

. . . to argue to the truth of an hypothesis 
by affirming the consequents is always a fallacy 
no matter how many consequents are affirmed. 
. . . The verification or disverification of the 
implicates is important and useful [for] its own 
account, for by it we discover something about 
the world in which we live, but the verification 
of the implicates does not establish the truth of 
the hypothesis (9, p. 727). 


When Seeman (14) seeks to make an 
“inductive leap” from the consequent to 
the theory, Behan and Behan (1) com- 
ment that the “inductive leap” amounts 
to the fallacy of asserting the consequent, 
an operation excluded in symbolic logic. 
Seeman replies: 


To call this “asserting the consequent”’ is to 
say either that all experimental procedure leads 
to this fallacy or to assert a stricture against all 
empirical science. . . . What purpose, after all, 
can an experiment serve if, from the results, one 
is forbidden to make inferences?” (15, p. 178). 


Here we truly have an important prob- 
lem that must be faced and solved. 

A part of the problem as summarized 
above results from a confusion of the 
different functions of inductive and de- 
ductive logic. As it is applicable here, 
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deductive logic is used in deriving more 
specific propositions (here, generally con- 
sequents) from more general ones (here, 
theories) ; whereas inductive logic is used 
in ascertaining the probability value of 
the more general propositions on the 
basis of the more specific ones. All the 
criticisms referred to above hold that 
when inference by confirmation is used, 
the fallacy of affirming the consequent 
is being committed. However, this argu- 
ment is incorrect because the fallacy of 
affirming the consequent is a fallacy of 
deductive logic, and in this situation 
we are concerned with inductive logic. 
The more proper name is the fallacy of 
incomplete schematization—and the fact 
remains that it is an erroneous pro- 
cedure ; nowhere in the calculus of prob- 
ability, and thus in inductive logic, may 
such an inference be found. 

We thus are faced with a vital ques- 
tion that needs to be answered before 
psychology can progress to an advanced 


state of knowledge, i.e., if inference by 
confirmation is an invalid procedure, 
what is a valid one by which we can test 


our theories? The answer to this ques- 
tion will serve at least two main func- 
tions: first, we will have available objec- 
tive specifications which will allow us to 
agree as to whether a given theory is 
confirmed or disconfirmed, rather than 
relying on the intuitive appraisal of the 
individual scientist; and second, we can 
discriminate between meaningful and 
meaningless propositions, since a proposi- 
tion is meaningful if and only if it is 
possible to obtain the kind of data that 
would be relevant to the confirmation or 
disconfirmation of it. There is no point 
in carrying out a large number of theory- 
oriented experiments if we cannot make 
valid inferences back to the theories 
which stimulated them. Hempel says 
that “The establishment of a general 
theory of confirmation may well be re- 
garded as one of the most urgent desid- 
erata of the present methodology of 
empirical science” (8, p. 3). That this 


is not an easy problem, however, is 
apparent from the diverse approaches 
and discordant views in the literature 
(e.g., 3, 4, 5, 7, 8, 12, 13). Realizing 
that anything else would be premature, 
we will present here a tentative solution, 
particularly with reference to psychology. 


TESTING THE THEORY 


The first step in testing a theory is to 
summarize the data of a given experi- 
ment in the form of an evidence report 
(Z). An evidence report is a proposi- 
tion which says that, when specified 
conditions obtain, a given entity either 
has or does not have, a certain attribute; 
it can therefore be either positive or 
negative. For instance, in the example 
previously cited, a positive evidence re- 
port would read: “x is an industrial work 
group in great inner conflict, and x has 
a low production level.” The precise 
method of arriving at an evidence report 
is not germane to our discussion, and 
therefore will not be elaborated here. 
The main problem is to confront the 
theory with the evidence report and 
determine whether the theory is con- 
firmed or disconfirmed. 


Strictly Verifiable Theories 


It can be shown that under certain 
circumstances it is possible to determine 
strictly the truth value of a theory solely 
on the basis of its consequents. We will 
here distinguish between the processes 
of verification and confirmation. Con- 
firmation allows classification of a theory 
as probable or improbable, and requires 
that we consider a number of separate 
evidence reports; while verification al- 
lows classification of a theory as com- 
pletely true or completely false, as based 
on only one evidence report. Verifica- 
tion, therefore, is a narrower term than 
confirmation, and may be included as a 
limiting case of confirmation where the 
probability is 1.0. Whether or not a 
theory can be verified is determined 
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exclusively by its logical form; in veri- 
fication we use deductive logic only. A 
positive universal theory (e.g., a > d) is 
thus verifiable if it is false, but not veri- 
fiable if it is true.‘ A negative universal 
theory (e.g., a + 6)5 is verifiable if it is 
true, but not verifiable if it is false (cf. 
Reichenbach [12, p. 341], Hempel [8}). 





Positive Evidence Reports and Positive 
Universal Theories 


We thus see that, under certain condi- 
tions, we can verify our theories. The 
heart of the problem remaining is to 
determine whether a positive evidence 
report is an instance of support of a 
universal theory. One promising possi- 
bility is to use inverse induction, par- 
ticularly Bayes’s rule (theorem), though 
the precise methods of its application are 
not available. 


The inference of indirect evidence. Ac- 
cording to Reichenbach “. . . the gen- 
eral inductive inference from observa- 
tional data to the validity of a given 
scientific theory must be regarded as an 
inference in terms of Bayes’s rule” (12, 
p. 95). In order to make a valid induc- 
tive inference, which Reichenbach terms 
inference by indirect evidence, certain other 
probabilities must be taken into account, 


*The calculus of propositions, a two-valued 
system, is being used here for stating theories. 
Strictly speaking, this is improper because all 
empirical propositions have a probability char- 
acter. However, since the logical treatment of 
theories in a two-valued logic is simpler than in 
probability logic, it is desirable to use the former 
(cf. 10). Reichenbach (12, p. 95) justifies the 
transition from a proposition stated in prob- 
ability logic to one in a two-valued logic under 
certain fairly liberal conditions, with the quali- 
fication that the probability of the theory does 
not attain certainty. We should assume this 
transition throughout the remainder of this 
paper, for purposes of approximation; this 
assumption should particularly be borne in mind 
with reference to Table 1. 

5A line above a symbol is the notation for 
the logical operation of negation; here it may be 
read “it is false that a implies 5.” 
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all of which are expressed in Bayes’s rule. 
This rule is derivable from the axioms 
of the calculus of probability, and it thus 
has the status of a theorem. It deter- 
mines inverse probabililies as a function 
of forward probabilities (the quantities 
on the left and the right, respectively, of 
formula 1). This inverse probability is 
the value that we wish to determine; 
i.e., it will tell us the probability that a 
positive evidence report (Z£) is an in- 
stance of support of a given theor, (7). 
The primary problems in using Bayes’s 
rule are in interpreting the probabilities 
it contains, and in defining the necessary 
reference classes. Following a frequency 
interpretation (cf. 12) we shall consider 
each probability as the limit of relative 
frequencies of positive instances among 
all relevant cases. Although there are 
no hard and fast rules for interpreting 
these probabilities and defining the neces- 
sary reference classes, we will suggest 
some tentative solutions. 

Let us first attempt to define the 
reference classes necessary to apply 
Bayes’s rule. A reference class com- 
prises the universe of things with which 
an inquiry is concerned; specifically, it 
is the class of elements of a sequence of 
events which determines the frequency 
ratio. One reason why we must con- 
sider reference classes is that, when using 
the calculus of probability, we can speak 
of an individual event only insofar as 
that event is an element in a specified 
reference class. We cannot, therefore, 
strictly speak of the probability of a 
single theory, but must consider the class 
of theories of which it is a member. 
The probability of an individual event 
(e.g., a theory) thus has a fictitious, but 
useful, meaning. In applying the rule 
of Bayes, there are four reference classes 
that we must define: A, E, T and T. 
Our aim is to develop the widest possible 
homogeneous reference classes. 

The reference class A may be con- 
sidered as the widest possible class of 
homogeneous theories. In other words, 
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we want to include in it as many theories 
as possible which are essentially similar 
to the theory with which we are dealing. 
If it is a learning theory, perhaps the 
reference class A will end up as all 
learning theories. In order to obtain a 
homogeneous reference class, we want to 
exclude from A those theories which are 
essentially different from our specific 
theory. Salmon (13) discusses the terms 
essential similarity and essential differ- 
ence, offers an apparently adequate 
method for defining them, and thus pro- 
vides a criterion for establishing a class 
of homogeneous theories. Our reference 
class A may be divided into several sub- 
classes; in our simplified case we will 
consider two subclasses, T and T. The 
subclass T may refer to true theories in- 
cluded in A; the subclass 7 will refer to 
false theories in A. The reference class 
E will refer to the class of positive evi- 
dence reports. A statement of Bayes’s 
rule is :® 


P(A.E,T)= 
P(A,T)-P(A.T,E) 
P(A,T): P(A.T,E)+P(A,T)-P(A.T,E) 
[1] 


The four different probabilities in- 
cluded in Bayes’s rule may now be inter- 
preted as follows: 

1. P(A,T) is known as the antecedent 
probability, and is the probability that a 
theory of the type with which we are 
dealing is true, irrespective of the evi- 
dence report under consideration. This 
probability is based on the limit of the 
frequency of true theories (7) included 
in the reference class A, to all of the the- 
ories in A(7+ 7). Reichenbach says 
of antecedent probabilities that they 
“. . . often need not be known other- 
wise than in the form of crude estimates, 
while the results of the inference can be 





6 The symbol “.” is the notation for the 
logical operation of conjunction and may be read 
and. The “P symbol,” e.g., P(A.E,T), may be 
read “The probability from A and E to T.” 
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Others hold 


very precise” (12, p. 432). 
similar views (e.g., 5, 6). 
2. P(A,T) is the probability that our 
theory is false, irrespective of the evi- 
dence report under consideration, and 
may be determined from formula 2: 


P(A,T) =1—P(A,T). [2] 


3. P(A.T,E) is the probability that 
when the initial conditions of the theory 
obtain, the consequences occur. Here 
the evidence report is positive (£) and, 
as Reichenbach says, the probability 
may be considered to be 1.0. If the 
evidence report is negative, this prob- 
ability becomes 0 (and the inverse prob- 
ability in formula 1 becomes 0). The 
fact that this probability can take on 
only the values 0 and 1, in the present 
context, results from our use of a two- 
valued logic for stating theories (see 
footnote 2). 

4. P(A.T,E) is the probability of ob- 
taining a positive evidence report under 
the condition that the theory is false 
and the statement of the evidence report 
is valid. This probability is part of the 
initial evidence; it asserts that the true 
value of the consequence of the theory 
is not affected whether or not the initia] 
conditions of the theory hold. It may 
be determined by computing the ratio 
of, positive evidence reports to all evi- 
dence reports obtained for the false 
theories contained in A. 

Let us now consider a lattice made up 
of theories that we wish to include in 
our reference class A (see Table i). The 
first row of the lattice will be composed 
of the positive and negative evidence 
reports obtained from a series of experi- 
ments designed to test theory 1; Row 2 
is similarly composed of evidence reports 
for Theory 2; and so on for, say, five 
theories. Let us assume that Theories 1 
through 4 are true (highly probable), 
while Theory 5, on the other hand is false 
(highly, improbable). 

7One might ask: How can we construct a 
lattice out of confirmed theories, when such a 
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TABLE 1 


A Lattice MApeE UP oF PosITIvVE AND NEGATIVE 
EVIDENCE REPORTS FOR FIVE THEORIES 
WuicH REFERENCE CLAss A INCLUDES 








Approxi- 
mate Truth 
Value of 
Theory 


Value of Evidence Reports 
Based on 10 Experiments 
Per Theory 


Theory 





True 
True 
True 
True 


+++++4++4+-+4+4+ 
++-++4++++4++4 
++4++4++4+4+4+4+ 
—+4++4+4+4+4+4+4+ 











We are now in a position to compute 
the probabilities contained in Bayes’s 
rule, and solve for the inverse probability 
that a positive evidence report is an 
instance of support of a theory belonging 
to the reference class A. 

The class A is thus composed of five 
theories; of these, four belong to class 7, 
and one belongs to class 7. To deter- 
mine the antecedent probability P(A,7), 
we take the ratio of true theories in A to 
the total theories in A, i.e., 4/5. We 
have previously indicated that P(A.T,E) 


is 1.0 in the case of a positive evidence . 
‘ but the general approach seems clear. 


report when the initial conditions of the 
theory held. P(A,T) is the ratio of false 
theories to total theories in A, i.e., 1/5. 
P(A.T,E) is then determined, by com- 
puting the ratio of the positive evidence 
reports obtained for a false theory (e.g., 
Theory five) to the total evidence reports 
for that theory; from the lattice it is 
seen to be 2/10 or 1/5. By substituting 
these values in Formula 1, the prob- 
ability that the evidence report supports 


lattice is a prior requirement for determining 
an instance of support for a theory? By suc- 
cessive approximation on the basis of induction 
by enumeration, and particularly relying on an 
inequality developed by Reichenbach (12, p. 
95), we should be able to answer this question 
with increasing precision. Further discussion of 
this point would lack the necessary brevity for 
presentation here, 


the theory can be seen to be: 
4/5-1 4) 
4/5-1+ 1/5-1/5 — 


952. 





P(A.E,T) = 


If this value is considered sufficiently 
high (a judgment similar to that which 
the scientist must make in setting the 
significance levels for rejecting the null 
hypothesis), then it can be concluded 
that this is an instance of support of 
the theory.2 If this probability is suffi- 
ciently low, the scientist may. conclude 
that this is an instance of negation of 
the theory. 

It should be added that Bayes’s rule 
appears appropriate to the problem re- 
ferred to above, where we have a number 
of different theories, all of which have 
the same consequence. The problem 
arises where we obtain a positive evi- 
dence report; we wish to determine for 
which one of the several theories that 
imply that consequence we have an 
instance of support. It would seem pos- 
sible to determine the inverse probability 
for each of the theories, and then to 
select the one that best satisfies our sig- 
nificance levels. This application of 
Bayes’s rule appears particularly knotty, 


The future worker should consider such 
problems as: (a) where the assumptions 
of mutually exclusive and exhaustive 
theories are not even approximately 
satisfied; (b) utilizing Bayes’s postulate, 
a simpler form of Formula 1, when there 
is definite knowledge that the antecedent 
probabilities of the several theories are 
equal; (c) the need for developing sepa- 
rate reference classes (i.e., A) for each 
of the several theories, or possibly utiliz- 
ing probability logic instead of a two- 
valued logic for stating our theories. 


8 Reichenbach’s criticism of inference by con- 
firmation can now be made more explicit; i.c., 
obtaining a positive evidence report where the 
initial conditions of the hypothesis held supplies 
only the probability P(A.T,E) = 1, leaving 
unknown the other probabilities required by 
Bayes’s rule, 
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CRITICISMS OF THE USE OF 
BayeEs’s RULE 


A number of criticisms of the general 
approach taken in this paper have been 
offered (e.g., 4,7). The essence of these 
criticisms seems to be that it is difficult 
to define a reference class, and that we 
do not have enough theories to provide 
us with the necessary mass of statistical 
data. These and similar criticisms are 
certainly important ones, and would 
compel us to abandon our attempts, if 
we had available more effective and promis- 
ing tools. Even though the scientist 
many times is faced with problems for 
which his tools have apparent and glaring 
defects, he does not abandon his efforts 
but does his best with the tools he has. 
The differing approaches of other workers 
are promising, particularly that of Car- 
nap (3). 

The considerations here and elsewhere 
suggest that the establishing of prob- 
abilities of confirmation offers no diffi- 
That we do not 


culties in principle. 
have a great number of data relative to 
these problems, that the probabilities 
are difficult to interpret, and that the 
necessary reference classes are not easily 
defined, do not constitute objections to 


the procedures here outlined. As Reich- 


enbach says, 


. speaking of the probability of an indi- 
vidual hypothesis offers no more logical difficul- 
ties than speaking of the probability of an 
individual event, say, the death of a certain 
person. . . . Should we some day reach a stage 
in which we have as many statistics on theories 
as we have today on cases of disease and sub- 
sequent death, we could select a reference class 
that satisfies the condition of homogeneity, and 
the choice of the reference class for the prob- 
ability of theories would seem as natural... . 
In some domains we have actually been wit- 
nesses of such a development. For instance, we 
know how to find a reference class for the prob- 
ability of good weather tomorrow; but before 
the evolution of a scientific meteorology this 
reference class seemed as ambiguous as that of a 
scientific theory may seem today (12, p. 440). 


SUMMARY 


The currently used procedure for test- 
ing theories, known as inference by 
confirmation, is invalid and is thus sub- 
ject to error. The main difficulty with 
inference by confirmation is that a given 
theory does not uniquely imply a certain 
consequence ; that consequence may also 
be implied by alterative theories of 
psychology. To make a valid inference 
(inference by indirect evidence), other 
probabilities must be taken into account, 
all of which are included in the rule of 
Bayes. In using Bayes’s rule one must 
establish reference classes composed of 
homogeneous theories, and interpret the 
probabilities it contains. A concrete 
method of applying Bayes’s rule is pre- 
sented in the present paper, though a 
number of problems are unsolved. It is 
expected that eventually a complete 
methodology will evolve that will make 
a technique available to the experi- 
mentalist and to the theory maker, with 
which valid inferences can be made. 
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Behavior theories in America today 
are commonly grouped in three classes, 
following Spence (17) : (a) S-R contiguity 
theories (Guthrie, Estes); (b) S-R re- 
inforcement! theories (Hull, Spence, 
Miller, Thorndike); (c) S-S contiguity, 
or expectancy, or cognition theories 
(Tolman, Lewin). We are here con- 
cerned with the second and third of these 
categories. In view of recent develop- 
ments it seems timely to ask what essen- 
tial differences, if any, remain between 
them. 

CHORDS AND DISCORDS 


Both reinforcement and expectancy 
theories can trace their descent from the 
psychological hedonism of Hobbes, Ben- 
Cognition theory, 


tham, and J. S. Mill. 
for all its behavioristic claims, is held by 
its critics to have a trace of ‘‘mentalism”’ 
in its blood. A human, said the hed- 
onist, acts with an eye to consequences, 
in such a way as to gain pleasure and 


avoid pain. So, in a sense, does Tol- 
man’s rat VTEing at a choice point. 
Reinforcement theory claims to have 
sprung from sturdy mechanistic stock ; its 
forebears sought some simple automatic 
process to explain adaptive behavior 
without invoking foresight. Thorndike 
found it in the strengthening of S-R 
bonds by satisfying consequences. Hull 
found one such process in the increment 
of habit strength produced by drive 
reduction. 

It is this attempt of the one theory to 
derive foresight, coupled with the other’s 
willingness to depend on it, that has 
chiefly set the two schools apart. It also 


1 Reinforcement is here used broadly to refer to 
the strengthening of an S-R connection by some 
other event occurring at the time. 


helps to explain their besetting weak- 
nesses : S-S theory has always had trouble 
getting from sensory integration to re- 
sponse; S-R theory tends to be “re- 
sponse bound,” to have trouble dealing 
with flexibility in a changing environ- 
ment. On the whole each has proved a 
healthy corrective to the other, and their 
differences have stimulated a wealth of 
investigation on such problems as latent 
learning, place learning, and continuity 
in discrimination learning. 

If these investigations have borne fruit, 
however, we should expect them either 
to substantiate one viewpoint at the 
expense of the other, or, more real- 
istically, to produce such changes in both 
as eventually to reconcile their differ- 
ences. MacCorquodale and Meehl’s (8) 
recent attempt to formalize expectancy 
theory, coming soon after Hull’s (5) last 
revision of his system, inevitably raises 
the question : how far have the two views 
moved toward each other, and on what 
issues are they still divided? 

In a brief paper a’ point-by-point com- 
parison of the two systems is out of the 
question. What we need is a single 
clear-cut issue most likely to reveal 
salient points of disagreement. Meehl 
and MacCorquodale (10) have antici- 
pated oursearch. After rejecting several 
properties of expectancy theory as not 
clearly definitive, they selected as the 
most likely candidate for a “core con- 
cept” an inference postulate. Without 
claiming that cognitive theory alone 
could derive inferential behavior, they 
did hold that nonexpectancy doctrine 
would find it difficult.2 Here, then, we 


2 More precisely, they held that nonexpectancy 
theories could derive inference only by intro- 
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have a method of comparison. It con- 
sists of using the inference paradigm as 
a criterion of how much reinforcement 
and expectancy theories overlap. After 
briefly outlining the expectancy approach 
as formulated by MacCorquodale and 
Meehl (8), I shall try to show informally 
how inference has been and can be 
handled by reinforcement theory. This 
undertaking will enable us to consider 
pertinent developments in Hull’s system, 
and to evaluate their significance for our 
general problem. 


INFERENCE IN EXPECTANCY THEORY 
Relevant Postulates 


To be fully understood these postulates 
should be read in the context of the entire 
set. Here a much condensed statement, 
stripped of quantitative detail, must 
suffice. Such a statement is necessary 
partly to make the derivation intelligible, 
partly to show why the authors put so 
much stress on the inference postulate. 


The original numbers are retained. 


1. Mnemonization. The occurrence of 
the sequence S;— R,— S2--- results 
in an increment in the strength of an 
expectancy (5:R,S2) (8, p. 237). 

4. Inference. The occurrence of a 
temporal contiguity S,S*, when (S,R,S2) 
has nonzero strength, produces an incre- 
ment in the strength of a new ex- 
pectancy (S,R,S*) (8, p. 242). 

9. Valence. The valence of a stimulus 
S* is a multiplicative function of the 
correlated need D and the cathexis C* 
attached to S* (8, p. 245). 

12. Activation. The reaction poten- 
tial sEr of a response R; in the presence 
of S; is a multiplicative function of the 
strength of the expectancy (S,R,S2) and 
the valence ...of the expectandum 
[Se] (8, p- 246). 

Postulate 4 is significant because, in 





ducing a mediating process such as the fractional 
antedating goal reaction rg. It would be arbi- 
trary to deny Hull the use of his own invention; 
our present interest is in how closely his use of it 
conforms to the tenets of expectancy theory. 
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Fic. 1. Diagram of a hypothetical situation 
to demonstrate inference. End boxes A, B, C, 
and E are distinctive in shape and material. 
They are connected by enclosed runways. Ac- 
cess to all runways is controlled by sliding doors, 
of which X and Y are two. 


combination with the others, it provides 
a way of strengthening sE,» (aside from 
increasing D) without evoking Ri, a 
difficult feat for S-R theories. It does so 
by substituting a more strongly cathected 
expectandum. Two other methods we 
shall find useful to achieve a like result 
are given in the following additional 
postulates : 

6. Secondary cathexis. The contiguity 
of S, and S*, when S* has valence |V |, 
produces an increment in the absolute 
cathexis of S, (8, p. 244). 

7. Induced elicitor cathexis. The ac- 
quisition of valence by an expectandum 
S_ belonging to an existing expectancy 
(S,R,S:2) induces a cathexis in the elicitor 
S; (8, Pp. 244). 


An Experimental Paradigm 


As an inference model take the situa- 
tion depicted in Fig. 1. The experiment 
is conducted in three stages: 

Stage I. A group of rats, 22 hours 
hungry, is given an equal number of 
forced trials in mixed order from C to B 
and from C to E, with no food in the 
apparatus and all other paths blocked. 
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Stage IJ. Half of the rats are run re- 
peatedly from B to A where they find 
and eat food ; the other half are similarly 
run from E tofoodin A. Again all paths 
are blocked other than the one used. 

Stage ITI. All rats are placed hungry 
in C with doors X and ¥ open, and given 
a free choice. Inferential behavior is 
measured by the preponderance of 
choices of the path leading to the box 
(B or E) used in Stage IT. 





1. As a result of I we have 


(SxRxSp) = (SyRySz) > 0. 
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Positive results in comparable situa- 
tions are not always obtained (22), but 
have been reported by several investi- 
gators (9, 12, 21). 

Derivation 

The following “proof” is based on the 
foregoing postulates, and modeled on the 
examples given by MacCorquodale and 
Meehl (7). In this and later derivations 
we need consider only the subgroup 
trained from B to A in Stage II. 


By Postulate 1. 


2. In II the valence acquired by S4 from the food eaten in A induces a cathexis 


in Sz; i.e., 


Csp Pa Csz- 
Vsp> Voz. 


3. In III we have 


By Postulates 1, 6, 7. 
By Postulate 9. 


syEry _ (SxRxSx) x V sp, and 


syEry = (SyRySz) X Vsz. 
SsxyEry > syEry. 


By Postulate 12. 
By Steps 1 and 2. 


This argument leads directly to the greater probability of the correct response. 


INFERENCE IN REINFORCEMENT 
THEORY 
Early Derivations 


Hull made two early efforts to account 
for inference; one (2) using a situation 
typical of Maier’s (9) reasoning experi- 
ments, the other (3) modeled on Buxton’s 
(1) latent learning experiment using a 
multiple-unit maze. His argument was 
essentially the same in both cases; ap- 
plied to the present model it would run 
as follows: 

1. In I, with minimal reinforcement, 
a distinctive reaction to end box B is 
weakly conditioned to the drive stimulus 
(Sp) and generalized to the starting 
point (Sx), where its proprioceptive im- 
pulse (sg) is conditioned to the approach 
response (Rx); i.e., 


Sx 


— oe 
ns 


1p—>Sp—eRx 
ee cal 


ise 





Similarly, 


\: -—ememeer 


y, 


: * ee 


* 


Te—>Se—eRy 


2. InjII,”"through the powerful rein- 
forcing agent (Sg) at A, the hunger drive 
stimulus is strongly conditioned to re- 
sponses occurring in B; i.e., 


Sp Sa Se 


Reps pR, =>s,= >Re 





Sp Sp D 


3. In III, at the choice point rz is 
weakly aroused by Sx and strongly by 
Sp; 1x is weakly aroused by both Sy and 
Sp; thus, 
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re—ese—Ry 


een Sy 


Since Rx is conditioned to stronger 
stimuli than is Ry, it is more likely to 
occur. (Elsewhere [14] I have given 
reasons for doubting that the strength of 
a nonmotivating stimulus like sg would 
determine choice.) 

In his last book, Hull (5) returned to 
Maier’s problem with a minor change of 
conditions and a new solution. His new 
model differed from ours in two ways: 
(a) In I he used a small food reward (S,) 
in both end boxes; in IT he used a large 
food reward (Sg). (b) He reversed the 
order of I and II; i.e., the rats were 
trained to the large reward in A before 
being trained to small rewards in B and 
E. His derivation was essentially as 
follows: * 

1. In II the important result is the 
conditioning of rg to stimuli from start- 
ing box B: 


Sp S4 Se 


\ 


Resp 


“ 


Rue sy Re 


1G— SG 


2. In I (which follows IT), anticipatory 
response-produced stimuli, carried for- 
ward in the sequence by stimulus traces 
(and by Sp), are conditioned to Rx and 
Ry as shown: 

’ The hypothetical role of Sp is here omitted 
to simplify the exposition. Since Sp was a con- 
stant factor throughout, it would contribute 
equally to both responses, aside from afferent 
interaction, leaving the balance of excitation 
otherwise unchanged. 





Sx S 
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3. In III we see again that more func- 
tional connections lead to Rx than to Ry. 

It is noteworthy that this time the 
extra bond comes from sg, surrogate for 
the large reward, as it should from the 
standpoint of expectancy theory and 
common sense. Besides, the later analy- 
sis puts at our disposal another interpreta- 
tion stemming from Hull’s (4) 1943 prin- 
ciples: by association with the large 
reward, sg has become a more powerful 
secondary reinforcer than sg, thus mak- 
ing syHry > syHry. 

But the new derivation is not entirely 
satisfactory. As Osgood (11, p. 618) has 
pointed out, it would work only if the 
large reward came first; otherwise sg 
would have no chance to be conditioned 
to Rx. MacCorquodale and Meehl (8, 
p. 243), too, made it clear that we cannot 
escape this objection by invoking sec- 
ondary reinforcement.‘ Unfortunately 
Hull’s latest treatment evidently pre- 
ceded his postulate revisions; had these 
been available he could have derived 
inference without restricting the order of 
the premises. Before attempting such a 
derivation we should therefore turn to 
the most recent form of his postulates. 


Revised Postulates: 1952 
Two major changes between 1943 (4) 
and 1952 (5) are worth noting because 


‘It should be noted that Hull’s earlier deriva- 
tion, based on conditioning of endbox reactions 
to Sp, was not subject to the same limitation. 
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their significance goes well beyond the de- 
riving of inference. In my opinion they 
do much to remove any basic difference 
between Hull’s position and Tolman’s. 
1. The first change was in the defini- 
tion of habit strength (sHr). Formerly 
Hull had made this construct a function 
of a number of variables, including 
amount, delay, and number of occur- 
rences of a reinforcing agent.® It was, 
indeed, this postulate that made Hull’s 
a reinforcement theory. In 1952 he de- 
fined sp solely by number of reinforce- 
ments (Postulate IV, 5, p. 6). Amount 
of reward now determined a new func- 
tion, incentive motivation (K), entering as 
a multiplier with drive (D), stimulus 
intensity dynamism (V), and sHp to 
produce reaction potential (sEp); i.e., 
by Postulate VIII (5, p. 7), 
sEr= DX KXV~X sHe. [1] 
The logical difficulty of separating the 
fact of a reward from its amount has 
already been pointed out (6, 13). Ifa 
reinforcer must be present to produce an 
increase in s//z, it must be present to at 
least a threshold degree. Only above 
that threshold can the rate of habit 
increase be independent of variation in 
amount of reward. Hull’s postulates 
imply that the least “diminution in the 
motivational stimulus” produces as much 
reinforcement as the greatest. But with- 
out a restrictive definition of “motiva- 
tional stimulus” one can never deny that 
such a stimulus may have diminished 
slightly (cf. Koch, 6, p. 106). In prac- 


5 A reinforcer he defined as “the diminution of 
a need” (primary reinforcement) or “a stimulus 
which has been closely and consistently associ- 
ated with the diminution of a need”’ (secondary 
reinforcement) (4, p. 178). Later he changed 
his definition of the primary reinforcer to “the 
rapid diminution in the motivational stimulus” 
(5, p. 6). 

®In connection with stimulus intensity gen- 
eralization, he added, with great uncertainty, 
a second factor, the intensity dynamism (V;) of 
the original stimulus. 
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tice, then, if not in theory, Hull has re- 
duced reinforcement to contiguity. 

2. The second major change pertinent 
to our inquiry is in Hull’s treatment of 
delay of reinforcement. Spence (18) 
earlier proposed a theory of delayed re- 
ward learning by immediate secondary 
reinforcement. This reinforcement re- 
sulted from two processes: (a) the condi- 
tioning of a consummatory response (Rg) 
to the stimulus pattern accompanying 
reward; (b) the arousal of a fractional 
consummatory response (rg) by the 
stimulus pattern accompanying the cor- 
rect response on the next trial. Strength 
of reinforcement depended on strength 
of rg, which in turn depended on the 
stimulus generalization gradient assumed 
to extend over the period of delay. 
Elsewhere (13) I have pointed out that 
this theory differed from an expectancy 
formulation only in casting rg— Sq as 
habit builder rather than as incentive. 

In his final revision Hull (5) incor- 
porated Spence’s theory, and implicitly 
abandoned this distinguishing feature. 
To verify my statement, consider Corol- 
lary iii of Postulate VIII (5, p. 7). It 
includes two parts: (A) the effect of 
terminal reinforcement on the reaction 
potentials of successive responses in a 
behavior chain; (B) the effect of rein- 
forcement at varying intervals after an 
isolated response. Part A, although it 
bears more directly on our inference para- 
digm, proved to be too complicated by 
overlapping traces for quantitative deri- 
vation. Part B, however, was worked 
out in enough detail to reveal its sig- 
nificance for the system as a whole. It 
is here reproduced as an equation: 


J = sErng= DX KXVs5 
X sHr X 10-* X Vs, 


where S is the distinctive stimulus pat- 
tern at the moment of R, S’ is its trace 
at the moment of reinforcement, b is a 
constant, and d = log S — log S’ in units 
of stimulus intensity. We shall now 
consider its derivation. 


[2] 





110 Joun P. 

Suppose, borrowing Hull’s example, 
that a rat is given distributed trials in a 
bar-pressing situation. When R occurs 
the bar is withdrawn; four seconds later 
a food reward (Sq) is presented and eaten 
(Re). Stimulus pattern S$ is therefore 
produced partly by the bar, partly by R 
itself, and may be denoted by RS. 
Owing to the decline of stimulus-trace 
intensity (RS’) during the delay, effec- 
tive reaction potential between RS and 
rq is given by the equation for stimulus 
intensity generalization (Postulate X B, 
5, p. 11): 


rsErg = DX K X Vrs X rsHrg, [3] 
where 
rsHrg ws rs’'Hyg Xx 10-*¢ x Vrs’. [4] 


To go from Equations 3 and 4 to 
Equation 2 we must assume that sHp 
can be substituted for gs-H,, and treated 
in the same manner. But such a pro- 
cedure implies that the sHx in question 
actually involves a residue of R (R’) con- 
ditioned at the moment of reinforcement 
to its own and other stimulus traces 
(RS’). To make this assumption is to 
explain delayed reward learning by fall- 
ing back on the tenuous hypothesis of 
backward conditioning. Any such argu- 
ment was surely far from Hull’s intention. 

We are forced to conclude that Corol- 
lary iii B is incorrectly derived, and that 
it does not properly refer to the instru- 
mental response as response at all. The 
correct equation is No. 3, defining reac- 
tion potential between the stimulus of 
bar pressing and the anticipatory re- 
sponse to the food reward. It is quite 
possible that this is what Hull had in 
mind; i.e., to make J, or sEr,, propor- 
tional to strength of goal anticipation. 
In that case Corollary iii B should be 
written : 

(S] 


where rsE,, is defined by Equations 3 
and 4, 

Before endorsing this definition let us 
consider the consequences : 


sEr, = C(rsE,g), 
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1. The strength of an instrumental 
response is directly determined by the 
strength of the fractional goal stimulus 
(rsg) aroused by it. 

2. Both Spence and Hull held that rs¢ 
produced immediate secondary reinforce- 
ment. If rsg exerts its influence directly 
on sEpr,, and not by way of sHpr, we 
must either abandon the reinforcement 
theory of delayed reward learning or 
restrict the term “reinforcement” to 
some meaning such as “facilitation.” 

3. As delay of reward approaches zero 
there is no reason to invent another 
mechanism of “reinforcement.” Logi- 
cally Postulate VIII should therefore be 
considered a special case of Corollary iii B 
where d= 0, making sEr = c(rsEzg) 
and sHr = rsHyg. 

4. Hull contended that by means of 
the antedating reaction he had derived 
expectancy within his own system (5, 
pp. 108, 151 ff.). My interpretation of 
Corollary iii B, however, makes ex- 
pectancy the keystone of the arch‘ be- 
tween the input and the output of be- 
havior. Compare, for instance, Mac- 
Corquodale and Meehl’s equation for 
sEr with Hull’s equation{in the form 
here proposed : 


MacCorquodale-Meehl : 
sEr = DXC X SR}S2. 
Hull (“corrected”’) : 
sEr = c(D X K X Vrs X rsH,g). 


Except for V, the status of which is 
doubtful (see 16), and with due regard 
to underlying differences of definition, 
the parallel is obvious. 


A Revised Derivation 


With these revisions in mind let us 
return to our experimental! paradigm and 
the derivation of inferential behavior. 
Reinterpreting Hull’s postulates as I 
have suggested, we may now reason as 
follows: 
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1. In I, since all drive reduction cannot be ruled out, we assume that equal reaction 
tendencies are acquired between the stimuli of entering doors X and Y and the 
antedating reactions to end boxes B and E, respectively; i.e., 


RSxE;p = D x Kp x Vesy x rsxHrp, 
DX Ke X Vesy X rsyH-,. By Postulate X B and Corollary iii A. 


rSyErp = 
RSxE,p = rsyE-g > slr, 


where slp is the reaction threshold. 


2. As a result of II, stimuli produced in B arouse antedating reactions to the food 


received in A; i.e., 


RS plrg = JD x Ke > Vesp 4 rsplrg- By Postulate X B and Corollary ili A. 


3. In III, on Trial 1, Sx produces an end-box surrogate rsg (Step 1). 


turn arouses rg (Step 2). 


But rszg in 


On the assumption that antedating reaction potentials can be summated, we there- 


fore write: 
(a) syEry = 


It will be observed that the greater 
strength of syEry, is attributed to the 
goal-anticipatory component (rs,£,,) 


indirectly aroused by Sx, even though rsq 
has never been associated with*Rx itself. 
As I tried to show in the preceding argu- 
ment, this step is justified because Hull 
made sHr depend solely on number of 
reinforcements, and held delay of reward, 
as represented by rg, to determine per- 
formance rather than habit formation. 
With or without his intent these revisions 
strongly imply a nonassociative, activat- 
ing, or motivating role for rg. If my 
interpretation is valid, Hull has avoided 
the criticism of Osgood and of Mac- 
Corquodale and Meehl, as previously 
mentioned, but only by abandoning the 
associative function of reward. 


CLos—E HARMONY 


A few years ago Spence wrote that, in 
his opinion, “as Tolman’s theory is de- 
veloped, the essential similarity of its 
formal structure to that of Hull’s theory 
will become more and more apparent” 
(19, p. 706). Since it remained for two 
admitted “fifth columnists” (7, p. 63) 
to “formalize” Tolman’s theory, such an 


C(rsyE-p + RSpErg); 
(b) syEry = C(rsyE;,). 
(c) « syEry> syEry. 


By Equation 5. 
By Steps 1, 3a, 3b. 


outcome would not be too surprising. 
More surprisingly, it appears that Spence 
would have predicted better if he had 
interchanged Tolman with Hull in the 
above quotation. Two examples from 
the preceding section will suffice: (a) 
Spence went on to say: ““The most funda- 
mental difference between them at the 
moment is the question whether or not 
reinforcement is a necessary condition 
for . . . learning.” We have seen that 
in Hull’s present system the reinforcer 
directly determines performance; its role 
in learning is reduced to a pseudoprob- 
lem. (6) MacCorquodale and Meehl 
held that a distinguishing feature of their 
formalization was the ease of deriving 
inference. We have seen that Hull’s 
present system need have no greater 
difficulty with this problem, since it pro- 
vides a closely analogous solution. 

In bringing out points of agreement 
between the two theories I have probably 
undervalued their differences. From a 
heuristic standpoint this is a more serious 
error than its opposite. As long as two 
theories in good standing lead to measur- 
ably different predictions, both have a 
function, regardless of their ultimate 
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truth value. What remaining issues en- 
title reinforcement and expectancy to 
coexistence? 

1. First to come to mind is the S-R 
versus S-S dichotomy, the question 
whether learning connects afferent im- 
pulses exclusively with efferent ones or 
also with other afferents. The impor- 
tance of the issue is debatable: Mac- 
Corquodale and Meehl (8, 10) have 
shown as much by debating it; Tolman 
(21), by disclaiming interest in it; and 
Spence (20), by pointing out that Hull’s 
mathematical definition would apply 
equally well to sHr and sHs. My own 
use of an ambiguous construct, the surro- 
gate response (rs), as a mediating process, 
simply sidesteps the problem (15). The 


reason for this neglect is that the ques- 
tion, as its wording implies, refers to 
physiological, not behavioral, events. 
At the behavioral level the important 
thing is that both theories have a 
mechanism by which anticipated events 
can modify present behavior. 


Whether 
that mechanism is sensory or motor can 
be decided only by special techniques 
such as neurosurgery or implanted elec- 
trodes. The existence of such tech- 
niques, however, gives the distinction 
meaning; its importance (whatever that 
may mean) can hardly be prejudged. 
Meanwhile an S-R position can be de- 
fended insofar as it alerts us to the possi- 
bility of eavesdropping on expectancy, 
whether by measuring VTE, action cur- 
rents, galvanic skin responses, or salivary 
secretion. 

2. The next point concerns no specific 
issue but something more subtle. It has 
to do with the common-sense distinction 
between explanation and _ prediction. 
Two theories may both prove capable of 
deriving, or explaining, an observed out- 
come, but only one of them may be likely 
to suggest it. The fruitfulness of a 
theory may, indeed, bear little relation 
to its structural formality. In its early 
stages every system generates experi- 
mental predictions, not out of clearly 
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stated postulates, but from loosely 
phrased assumptions about the nature of 
its subject matter. One danger of pre- 
mature formalization is that this period 
of relatively free exploration will be cut 
short.’ A cognition theorist, e.g., thinks 
of response as incidental to perception. 
Taking high-level, integrated behavior as 
the norm, he looks for evidence of flexi- 
bility, insight, reasoning—and is fre- 
quently disappointed when simple organ- 
isms fail to provide it. A reinforcement 
theorist, on the other hand, thinks of a 
response as reflecting the strength of its 
connection to some immediate stimulus 
(sEr). He seeks to describe the condi- 
tions determining sEpr as a set of con- 
tinuous functions—and is disturbed by 
the discontinuities that sometimes ac- 
company a change in external or internal 
conditions. After this happens he can 
often account for it by introducing a 
functional equivalent of the mediating 
process that the cognition theorist started 
out with. My point is that each doctrine 
has an underlying bias that encourages a 
different type of speculation. The leav- 
ening effect of these attitudes on research 
is worth preserving as long as possible. 

3. As theories crystallize, deductions 
must inevitably conform more closely to 
the specific form of relevant postulates. 
Loss of flexibility is balanced by the 
sharpening of discrepancies between pre- 
diction and outcome. Gross parallels be- 
tween tentative postulate sets, such as 
those we have noted between Mac- 
Corquodale and Meehl’s and Hull’s, 
should not blind us to the finer quantita- 
tive differences that will continue to 
stimulate and guide research. 

We have drawn a picture of two ap- 
proaches converging toward a common 
set of principles. Major controversial 


7It may be no accident that so many of the 
controversies between adherents of Tolman and 
Hull—e.g., latent learning, irrelevant incentive 
learning, “hypotheses” in rats, place learning— 
started with experiments either suggested or 
carried out by Tolmanites, 
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issues will undoubtedly become harder to 
find. It may console belligerents on 


both sides to remember that the primary 
function of a systematic viewpoint is not 
to win battles but to make testable 
predictions. 


SUMMARY 


This paper is an attempt to appraise 
the present status of reinforcement and 
expectancy theories as exemplified by 
Hull’s (5) latest revision and MacCor- 
quodale and Meehl’s (8) recent “formal- 
ization” of Tolman’s view. Specifically, 
the two systems are compared in their 
approaches to the derivation of inferen- 
tial behavior. Hull’s redefinition of 
habit strength changes the meaning of 
“reinforcement,” while his use of rg in 
deriving the effect of delayed reward 
makes goal anticipation the major de- 
terminant of reaction potential. As a 
result of these changes, inference can be 
derived without the restrictions met by 
Hull’s earlier attempts, in a manner 
closely analogous to that of expectancy 
theory. 
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By 1947 no less than ten writers had 
come to the conclusion, more or less in- 
dependently, that there are two sepa- 
rate and distinct learning processes. In 
that year the present writer (24) re- 
viewed the evidence for and against this 
position, and dubbed it “two-factor” 
theory. And a more recent review of 
the literature (25) shows that since 
that date a good many others have 
adopted, with minor variations, the 
same point of view. 

Basically the two-factor, or two-proc- 
ess, hypothesis holds that habits are 
learned on the basis of the reinforce- 
ment provided by reward, or drive re- 
duction, and that fears are learned 
(conditioned) on the basis of contigu- 
ous occurrence of a signal and punish- 
ment, in the sense of drive induction. 
Pavlov had held that all learning is a 
matter of conditioning or stimulus con- 
tiguity, while Thorndike and Hull had 
stressed habit formation on the basis of 
reward. Two-factor theorists, by con- 
trast, have held that it is not here a 
matter of either-or but of both: both 
sign learning (conditioning) and solu- 
tion learning (habit formation). 

It will not be necessary at this time 
to review the various arguments favor- 
ing the two-factor position. Instead, 
attention is directed to two palpable 
weaknesses. In the first place, the con- 


1 Read at the October, 1954, meeting of the 
Illinois Psychological Association, and at De- 
Pauw University in May, 1955. For highly 
useful criticisms of a preliminary draft of this 
paper (see last section), the author is indebted 
to M. E. Bitterman, F. S. Keller, K. S. Lash- 
ley, K. F. Muenzinger, Murray Miron, J. P. 
Seward, and R. L. Solomon. 


cept of habit, as a bond or connec- 
tion involving lowered synaptic resist- 
ance between a given stimulus or situa- 
tion and a fixed, stereotyped response, 
has continued to draw—from Lewin, 
Tolman, Lashley, and many others—a 
variety of cogent criticisms. Moreover, 
as a result of extensive laboratory work 
on what has been designated as second- 
ary reinforcement, we know that fear 
conditioning is not the only kind of 
sign learning; with reinforcement of the 
type which is supposed to be peculiarly 
appropriate for habit formation, a type 
of conditioning also occurs. 

In the pages which follow, an attempt 
will be made to reformulate two-factor 
theory so as to accommodate the well- 
established fact of secondary reinforce- 
ment. And such a reformulation leads, 
we shall discover, to a considerably 
modified conception of habit, one which 
is basically compatible, as the tradi- 
tional conception has not been, with 
“field theory” and which has various 
other integrative possibilities. 


PUNISHMENT AND AVOIDANCE 
LEARNING 


For a long time psychologists were 
inclined to assume, with Thorndike, 
that punishment was merely the antith- 
esis of reward, reward “stamping-in” 
habits and punishment “stamping-out” 
such bonds or connections. Learning 
was thus seen as a reversible process, 
reward causing it to move in one direc- 
tion and punishment causing it, simply 
and directly, to be reversed, obliterated. 

But then, roughly twenty years ago, 
a number of workers became interested 
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in what has since been termed avoid- 
ance learning. Here a painful, “pun- 
ishing” stimulus was used, not as a 
means of inhibiting an already estab- 
lished response, but as a means of in- 
stituting a new one. For example, 
Hunter (13) constructed a circular 
alley, the floor of which consisted of 
several metal grills which could be in- 
dependently electrified. He then found 
that if a rat was placed in such an 
apparatus and if a buzzer was briefly 
sounded before the particular section of 
grill on which the rat was sitting was 
electrified, only a few repetitions of this 
procedure were required before the rat, 
upon presentation of the buzzer, would 
run to the neighboring section of the 
floor grill, thus avoiding the shock which 
would have been applied if the rat had 
remained where it was when the buzzer 


came on. 
Some investigators were inclined to 
interpret avoidance learning of the kind 


just described in terms of simple con- 
ditioning. Running was said to be the 
unconditioned response to shock; and 
after buzzer and shock had been paired 
a few times, it was only to be expected, 
according to this view, that the run- 
ning response would start occurring, 
anticipatorily, to the buzzer alone. But 
further analysis of this phenomenon has 
shown that it cannot be interpreted so 
simply. It is now clear that the first 
thing that happens in a situation of the 
kind described is that the buzzer ac- 
quires the capacity to make the subject 
afraid; then, as a seemingly quite sepa- 
rate process, the subject learns to do 
whatever will reduce its fear. This may 
involve behavior which is quite unlike 
that manifested in response to the un- 
conditioned stimulus (28). 

Once this way of thinking—which, 
incidentally, played an important role 
in prompting the original two-factor 
distinction between sign learning and 
solution learning—was well established, 
it was but a short step to a new theory 
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of punishment (22). If an external 
stimulus, like the buzzer in the Hunter 
experiment, becomes conditioned to the 
emotion of fear as a result of being 
paired with shock, then does it not fol- 
low that an internal stimulus or pat- 
tern of stimuli, produced by an organ- 
ism’s own behavior, will likewise, if 
paired with shock, become conditioned 
to fear? But in this case, though the 
principle be the same, the effect is dif- 
ferent. In the Hunter-type situation 
the animal reduces fear and avoids 
shock by doing something, whereas in 
the situation just described the best 
way of reducing fear and avoiding shock 
is to do nothing, or at least nothing 
very similar to the action which has 
been associated with punishment. 

In this way, by using the same set of 
principles, we account equally well for 
situations where “punishment” is used 
to instigate behavior and where it is 
used to inhibit it. These principles now 
seem to be generally accepted (4, 7, 37, 
42). 


FEAR CONDITIONING AND SECONDARY 
REINFORCEMENT 


In the preceding discussion, the cen- 
tral concept is fear conditioning. As is 
well known, this is best achieved by 
pairing 4 formerly neutral stimulus 
with the onset of a painfully intense 
stimulus. The present writer has previ- 
ously suggested (23) that fear might be 
thought of as the conditioned form of 
the pain reaction; but Miller (20) has 
made a different and probably more 
nearly correct suggestion. He has 
pointed out that intense, noxious stimu- 
lation produces not only the sensation 
of pain but also directly arouses fear 
and that, in conditioning, this response 
simply gets transferred from the noxious 
stimulus to an originally neutral one. 
In other words, Miller suggests that 
fear is an inherent component of the 
total reaction, or drive state, produced 
by painfully intense stimulation but 
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that this component can be detached 
from its original constellation and made 
to occur in, so to say, pure form by the 
process of conditioning. This interpre- 
tation of fear conditioning is schema- 
tized in Fig. 1. 

In the preceding section it is assumed 
that once a fear has become connected 
to a particular stimulus or situation, any 
response which lessens the fear, i.e., 
eliminates the stimulus causing it, will 
be reinforced. If the fear-arousing 
stimulus is external to the organism, be- 
havior will be reinforced if it carries the 
organism away from the stimulus; and 
if the fear-arousing stimulus is internal, 
i.e., response-produced, the organism 
will be relieved, rewarded, reinforced 
for discontinuing the behavior which is 
responsible for such stimulation. In 
the one case, the organism may be said 
to be motivated to “get out of harm’s 
way”; in the other case, to “avoid 
trouble.” In both instances, however, 
the resulting behavior is fear-prompted 
and is reinforced by fear reduction. 

If behavior is motivated by a bio- 
logically given, or “primary,” drive such 
as hunger or thirst, the relief and satis- 
faction experienced when the drive is 
reduced are known as primary rein- 
forcement. It was therefore quite natu- 
ral that as our understanding of the mo- 
tivational and reinforcing properties of 
fear increased, there would be a tend- 
ency to speak of this emotion as an ac- 
quired, or “secondary,” drive and of the 
relief and satisfaction experienced when 
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it is reduced as secondary reinforce- 
ment. This usage has numerous advo- 
cates (22, 29a, 37), but it is at variance 
with another interpretation of the same 
expression. 

Long ago Pavlov (31) demonstrated 
what he called second-order, or second- 
ary, salivary conditioning; and, in 1943, 
Hull (12) reviewed a wide range of evi- 
dence showing that a stimulus which has 
been associated with food (hunger re- 
duction) not only has the capacity, 
which Pavlov had noted, to mediate 
higher-order conditioning, it can also be 
used to establish new, instrumental acts, 
or “habits,” just as can food itself. 
This latter capacity, which is acquired 
by a stimulus that is associated not only 
with hunger reduction but with the re- 
duction of any primary drive, has also, 
reasonably enough, come to be known 
as secondary reinforcement, despite the 
fact that it seems, superficially at least, 
to be something quite different from the 
type of secondary reinforcement first 
discussed. 

Fortunately, the Miller interpretation 
of fear conditioning points the way to 
a possible reconciliation of these two 
seemingly discordant views of second- 
ary reinforcement. If fear, as shown in 
Fig. 1, is part of the total response pro- 
duced by an intense primary drive, then 
fear reduction ought to occur shortly 
after termination of the primary drive, 
as suggested schematically in Fig. 2. 
If, moreover, a signal occurs just be- 
fore the primary drive terminates, one 











Primary motivation 


(e. g., shock) 
Fic. 1. 


Diagrammatic representation of fear conditioning. This emotion is originally elicited 


by some primary drive, such as electric shock; but if some other, formerly neutral, stimulus im- 
mediately precedes the primary drive, the fear response, after a few pairings of signal and 
drive, will become attached to the signal and “move forward,” as shown by the broken line. 
When this occurs, the fear response is said to have become anticipatory; it is then capable of 
independently motivating and reinforcing behavior. 
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An extension of the thinking represented in Fig. 1. 


Here it is assumed that an in- 


tense primary drive, such as electric shock, will be accompanied by some degree of apprehension 
or fear throughout its duration, and that this fear will terminate shortly after the primary drive 


terminates. 


If, now, a signal regularly and closely precedes these two events, it is not unlikely 


that it will become capable of producing a lessening of fear, or arousal of “hope,” somewhat in 


advance of termination of the primary drive, as shown by the broken line. 


This type of con- 


ditioning is here assumed to provide the basis of one type of secondary reinforcement. 


might suppose that the fear reduction 
would become anticipatory and occur, 
in response to the signal, as shown in 
Fig. 2 by the broken line. Many com- 
monplace as well as laboratory observa- 
tions give credence to this inference. 
One example, taken irom the current 
Reader’s Digest, will suffice. In an 
article entitled, “The Why of Aches 
and Pains,” Edward and Ruth Brecher 
(3) describe some recent researches by 
Hardy, Wolff, and Goddell on pain and 
pain alleviators. Here they say: 


Mental expectation of pain relief has much 
the same effect as chemical pain-relievers such 
as aspirin. Drs. Hardy and Wolff have com- 
pared the effect of aspirin with the effect of 
fake pills which the patient thinks are aspirin. 
They report that about half of the pain-re- 
lieving effect is produced by the aspirin itself 
and the other half by the patient’s confident 
expectation that the tablet will relieve him 
(3, pp. 75-76) .? 


But how does all this bear upon the 
Pavlov-Hull type of secondary reinforce- 
ment? It is well known that a stimulus 
which has been associated with hunger 
or thirst reduction works as a second- 
ary reinforcer best (in many instances 
only) if the drive with whose termina- 
tion it has been associated is again pres- 
ent. In other words, the secondary re- 
inforcing stimulus seems to give promise 
of relief from the “pain” caused by the 
primary drive, i.e., it reduces the fear 


2For a more technical presentation of the 
evidence for this notion, see Elithorn, Piercy, 
and Crossley (7a). 


that accompanies any strong, persistent 
drive. If such a drive is not present, 
then a stimulus promising relief there- 
from is not ordinarily very meaningful 
or effective. 

In this relatively simple way, one 
can harmonize the two interpretations 
of secondary reinforcement mentioned 
above. Both, it seems, involve a decre- 
ment in the secondary drive of fear. 
But there is this not insignificant dif- 
ference: in the one case, the fear is re- 
duced by disappearance of the stimulus 
or signal which, alone, has aroused the 
fear; whereas, in the other case, the fear 
is reduced by the appearance of a stimu- 
lus which promises (gives “hope”) that 
the primary drive which is causing the 
fear will shortly terminate. Hence we 
are led to speak of two types of “fear 
conditioning”: conditioned arousal of 
fear and conditioned relaxation, or re- 
lief, thereof. Secondary reinforcement, 
decremental type, may thus be mediated 
either by the end of a stimulus which 
has been associated with the onset of a 
more primary discomfort or by the on- 
set of a stimulus which has been associ- 
ated with the end of such discomfort. 


Two-Factor THEORY RECONSIDERED 
AND REVISED 


Two-factor learning theory, in its 
original version, held that “habits,” i.e., 
instrumental, behavioral solutions to 
problems, are learned on the basis of 
drive reduction and that fear becomes 
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conditioned to new signals or signs on 
the basis of drive induction. In the 
preceding section it has been shown that 
there are, in reality, two types of fear 
conditioning, namely, that whereby a 
formerly neutral stimulus becomes ca- 
pable of arousing fear and that whereby 
a formerly neutral stimulus becames ca- 
pable of allaying fear—and producing 
“hope.” By recognizing these two forms 
of fear conditioning, rather than only 
one, it is possible, as shown, to recon- 
cile and integrate two seemingly incom- 
patible conceptions of secondary rein- 
forcement. This reconciliation, we then 
discover, has important implications for 
the concept of habit, and leads to a re- 
vision of two-factor theory. 
Incremental fear conditioning and its 
uses are relatively well understood. We 
know, as previously indicated, that if 
fear arousal is conditioned to a stimulus 
which is external to the organism, the 
organism will be motivated by the fear 
to get rid of that stimulus, and very 
often the best way of doing that is to 
retreat from it. If, on the other hand, 
fear arousal becomes conditioned to a 
stimulus that is internal (response-pro- 
duced), the organism will. be motivated, 
no less than in the other type of situa- 
tion, to get rid of the fear; but now the 
best way of doing so is for the organ- 
ism to inhibit the response which pro- 
duces the fear-arousing stimulation. 
The question which naturally sug- 
gests itself next is this: Are there, in 
the case of decremental fear condition- 
ing, two different types of effects which 
likewise depend upon whether the con- 
ditioned stimulus is internal or external 
to the organism? We now know some- 
thing about what happens if an ex- 
ternal stimulus acquires the capacity to 
reduce fear, or arouse hope. This is 
the familiar phenomenon of secondary 
reinforcement, in the sense in which 
Pavlov and Hull used the term. Let us 
take an example. Suppose that a tone 
has been sounded for a few seconds just 
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before a hungry rat is given food. After 
several repetitions of this tone-food se- 
quence, it will be found that the rat is 
apparently relieved by and “likes to 
hear” the tone. This can be demon- 
strated by simply making it possible for 
the rat to produce the tone by pressing 
a little metal bar (35). The rat will 
press the bar repeatedly, until the tone, 
because it is not now followed by food, 
eventually loses its reassuring, hope-in- 
ducing capacity. The rat, so to say, 
“hoards” the tone, presumably because 
it feels “better,” “safer,” when hearing 
than when not hearing it. Secondary 
reinforcement, as thus mediated by an 
external stimulus, can be demonstrated 
in numerous other ways; but this one 
example will suffice for present purposes. 

Now against the background of the 
foregoing discussion, one will wish to 
know what happens if secondary rein- 
forcement, or fear decrement, becomes 
conditioned to internal, response-pro- 
duced stimuli. A commonplace illus- 
tration is instructive. 

Suppose one takes the right foreleg 
of a gentle, friendly, but somewhat 
hungry dog and flexes it acutely—so as 
to produce a distinctive pattern of in- 
ternal stimulation—and then gives the 
dog a bit of food. In this way, hope, 
reassurance, fear relaxation, or second- 
ary reinforcement becomes conditioned 
to a specific set of proprioceptive and 
other stimuli. What is the result? Since 
the dog can itself produce such a pat- 
tern of stimulation (like the rat when 
the bar is made available), it will not 
be long until we see the dog “volun- 
tarily” flexing its right foreleg. We 
then say the dog is offering to “shake 
hands” or that it is “begging” for food. 
But whatever the social implications of 
this action, we can confidently infer that 
the dog “likes the feel” of the pattern 
of self-stimulation thus produced, just 
as the rat, in the preceding illustration, 
appears to enjoy hearing the external 
tone. 
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Suppose we then use a different pro- 
cedure. Instead of ourselves producing 
in the dog the particular pattern of in- 
ternal stimulation which we wish to re- 
inforce, let us wait until the dog, in the 
course of its own spontaneous behavior, 
makes the required response. Reward 
is administered whenever this response 
occurs, and gradually its frequence of 
occurrence increases. Here the pro- 
cedure may be somewhat less efficient 
than where the dog is “put through” 
the behavior which produces the desired 
pattern of stimulation; but there seems 
to be no difference in principle. In 
both cases, what we have presumably 
done is to attach secondary reinforce- 
ment to a particular set or pattern of 
stimuli; and it does not matter much 
whether the stimulus is external or in- 
ternal: the organism will in both in- 
stances try to “get more” of the stimu- 
lus and in so doing will behave in a 
specifiable and distinctive way. 

Under the influence of Thorndike, our 
tendency has been to think of habit for- 
mation as follows. An organism is 
prompted, by some drive such as hun- 
ger, to engage in trial and error, or 
“variable,” behavior. One of the re- 
sulting responses, which in the begin- 
ning is but weakly connected with this 
drive, proves to be correct, i.e., gets re- 
warded. The result: a strengthening of 
the neural “bond” between the drive 
and this particular response. This is 
the essence of habit formation, as tradi- 
tionally—and still widely—conceived. 

In the present paper we are trying to 
look at the learning involved in so-called 
habit formation in a different way. Here 
we are thinking of it, not as the strength- 
ening of a neural connection or pathway 
between a drive and a particular piece 
of behavior but rather as the strength- 
ening of the neural pathway between 
the stimuli produced by a particular re- 
sponse and the phenomenon of second- 
ary reinforcement. 

Twenty years ago, punishment and 
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avoidance learning seemed to be quite 
different orders of events. Today we 
explain them both in terms of a com- 
mon, simple set of principles. Until re- 
cently we have tended to think of habit 
and of secondary reinforcement as dis- 
tinct phenomena. Secondary reinforce- 
ment could strengthen habit, but they 
were different. Here we are exploring 
the possibility that both habit and sec- 
ondary reinforcement are, at bottom, 
the same sort of thing; both, it seems, 
involve the conditioning of fear decre- 
ment, or “hope,” to particular stimuli. 
Whether these stimuli originate within 
the organism or are external to it is of 
practical but apparently no theoretical 
importance.* 


SUPPORTING LABORATORY EVIDENCE 


A well-established laboratory finding 
will help concretize this revised notion 
of habit. Originally Bugelski (5) and, 
more recently, Miles * have reported the 
following sort of observation. Suppose 
the habit of bar-pressing is established 
in rats as a means of obtaining food. 
The “strength” of such a habit is often 
measured in terms of its resistance to 
extinction, i.e., its persistence after the 
withdrawal of food as a reward. In 
this connection it has been found that 
resistance to extinction is greater if per- 
formance of the response is accompanied 
by one or more external secondary rein- 
forcers. For example, suppose a buzzer 
has sounded each time a rat has pressed 
the bar and obtained a pellet of food. 
The finding is that bar-pressing will 
continue longer if, after food has been 
withdrawn, the buzzer continues to oc- 


3 Pieces of this argument have been devel- 
oped in earlier studies (26, 27; see also the 
writer’s “Is ‘habit strength’ merely ‘secondary 
reinforcement’?”, mimeographed, 1953, pp. 
76). It is hoped that book-length discussion 
and relevant research will follow. 

4Cf. Miles, R. C. The relative effectiveness 
of secondary reinforcers throughout depriva- 
tion and habit-strength parameters (to be 
published) . 
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cur each time the bar is pressed than it 
will if the buzzer is also eliminated. 

The conventional interpretation of 
this finding has been to the effect that, 
after primary reinforcement (food) is 
discontinued, habit strength is kept up 
by the secondary reinforcement pro- 
vided by the buzzer. The alternative 
suggested here is that secondary rein- 
forcement is the habit and that if all 
stimuli which have been associated with 
hunger reduction were eliminated, the 
habit would disappear forthwith. Nor- 
mally, there are both external and in- 
ternal stimuli which accompany the oc- 
currence of a rewarded, or punished, re- 
sponse. The external stimuli can often 
be eliminated, as in the type of experi- 
ment just cited, with an ensuing loss of 
habit strength. The assumption is that 
if the associated internal stimuli, arising 
from the movement of muscles, tendons, 
and joints and from cutaneous and pres- 
sure receptors could likewise be elimi- 
nated, the loss of habit strength would 
be immediate and total. 

Although there is apparently as yet 
no empirical support for the assump- 
tion, it follows from the foregoing analy- 
sis that the effects produced by punish- 
ment could be likewise manipulated. If 
a buzzer accompanied some punished 
act, recovery from the resulting inhibi- 
tion would probably be more swift if 
the buzzer were disconnected; and if 
the internal stimuli associated with the 
act could be eliminated, one would ex- 
pect the punished, and thereby inhibited, 
response to “come back” very rapidly 
indeed and perhaps quite completely. 

Experimental work carried out by 
Loucks (17) and by Konorski (15, 16) 
provide other illustrations of the gen- 
eral applicability of the hypothesis ad- 
vanced in this section. 


Hapit, FEEDBACK, AND FIELD THEORY 


It would be misleading if the concep- 
tion of habit just described were pre- 
sented as something entirely new. The 
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present writer hopes he does no injus- 
tice to the thinking of field theorists in 
general and that of Tolman (38, 39, 
40) in particular in suggesting that the 
present formulation has a good deal in 
common therewith. 

The principal difference lies, perhaps, 
in this: Although field theory and the 
present analysis arrive, in the end, at a 
somewhat similar position, they reach 
this point by different routes and from 
different starting points. The present 
discussion has done little more than 
trace the evolution of stimulus-response 
psychology over the past quarter of a 
century. If, in psychology, we are be- 
ginning to see that “all roads lead to 
Rome,” this will hardly be an occasion 
for regret. 

Added justification for such optimism 
is to be found in recent publications by 
Birch and Bitterman (2), Denny and 
Adelman,® Dinsmoor (6), McClelland 
(18, 19), Muenzinger (29), J. P. Sew- 
ard (32, 33, 34), and in the two publi- 
cations by Konorski (15, 16) already 
cited. It is not possible here to make 
a detailed comparison of the theoretical 
positions of these writers and that sug- 
gested in the present paper. At first 
blush, the differences may seem more 


. striking than the similarities; but care- 


ful study of the works cited will show 
that they are focusing upon many of the 
same problems and that, in many in- 
stances, they arrive at fundamentally 
similar conclusions. 

Movement away from the S-R bond 
conception of habit has undoubtedly 
been facilitated in the minds of various 
psychologists by recent developments in 
the field of cybernetics (36, 41). Here 
the emphasis falls, not upon machines 
which merely transmit power, by means 
of pulleys and gears and drive rods, but 


5Cf. Denny, M. R., & Adelman, H. M. 
Elicitation theory II: The formal theory and 
its application to instrumental escape and 
avoidance conditioning. Unpublished manu- 
script. 
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Schematic representation of the two halves, or aspects, of Thorndike’s Law of Effect. 


It held, in essence, that if some drive stimulus Sa produces some instrumental (behavioral) re- 
sponse R,, and if R; is then followed by reward, this Sz——R, sequence, or bond, will as a re- 
sult be strengthened (diagram at left) and that if such a stimulus-response sequence is followed 
by punishment, the bond will as a result be weakened (diagram at right). 


upon machines into which are built deli- 
cate devices for self-regulation. Here 
the phenomenon of feedback is crucial: 
the machine is so constructed that it re- 
sponds to the effects produced by its 
own behavior and in this way achieves 
a level of “intelligence” far transcending 
that exhibited by any device which is a 
mere power conveyor. 

If learning is the central factor in the 
intelligence of living organisms, would 
it seem more likely to involve changes 
in the neural (motor) pathways which 
transmit power or in the neural path- 
ways which connect external and in- 
ternal sources of information with the 
“central” controlling mechanisms? In 
the present paper it is suggested that all 
learning is in the nature of sign learn- 
ing, significance learning, meaning learn- 
ing. When a stimulus (external of in- 
ternal) is repeatedly paired, or corre- 
lated, with a bad experience, i.e., with 
drive. increment, a meaning (fear) is 
learned which tends to prevent recur- 
rence of that experience. On the other 
hand, when a stimulus (external or in- 
ternal) is repeatedly paired with a good 
experience, i.e., with drive decrement, a 
meaning (fear decrement or hope) is 
learned which tends to insure recurrence 
of that experience. Thus, habit forma- 
tion and fear conditioning (incremental 
type), which were the two factors in 
the original version of two-factor learn- 
ing theory, give way to incremental fear 
conditioning or secondary motivation 
and decremental fear conditioning or 
secondary reinforcement. These phe- 
nomena correspond, respectively, to the 
negative and positive valences, vectors, 


or expectancies of field theory and, at 
least loosely, to the two kinds of “in- 
formation”—“on” and “off,” “yes” and 
“no”—involved in servo (feedback) 
mechanisms. 


ORIGINAL AND REVISED Two-FAcTor 
THEORY COMPARED 


The original version of two-factor 
learning theory now appears, in retro- 
spect, as a sort of stepping stone, inter- 
mediate between monistic interpreta- 
tions and the revised two-factor position 
here presented. The systematic rela- 
tionships here involved may be sum- 
marized as follows. 

Thorndike’s Law of Effect is schema- 
tized in Fig. 3 and the Pavlovian con- 
ception of conditioning is represented in 
Fig. 4. Each alone, according to its ex- 
ponents, was capable of accounting for 
the basic facts of learning; but others 
felt that both conceptions were neces- 
sary. Two-factor learning theory, as 
envisioned a decade ago, accepted, es- 
sentially unmodified, the “first half” of 
the Law of Effect, which held that re- 
ward strengthens habit; but it departed 
from the Law of Effect in holding that 


So~s_ 


Sy—>R 





S-——R 


Fic. 4. Schematic representation of condi- 
tioning, as conceived by Pavlov. S. is a 
stimulus which, initially, is not capable of 
eliciting response R, but which, as a result of 
contiguous occurrence with S, (above, left), 
acquires this capacity (above, right). The 
subscripts c and u are used to designate, re- 
spectively, what Pavlov termed the “condi- 
tioned” and the “unconditioned” stimulus. 
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S¢-——R; : reward 


Sg==——fi. 


Fic. 5. 


Sx 
Sd to 
§--—S (14) 


Ss 


Sg Rj : Sr 


re 


Schematic representation of the original version of two-factor learning theory. Ac- 


cording to this formulation, habits were made by reward, as shown at the left, in essentially the 


way suggested by the Law of Effect. 


However, punishment was assumed to involve fear con- 


ditioning, as shown at right, with ensuing conflict and probable inhibition (see text). 


punishment achieves its action, not by 
simply reversing the effects of reward, 
but by causing fears to become attached 
(conditioned) to stimulation associated 
with the occurrence of the punished re- 
sponse. This version of two-factor 
theory is shown in Fig. 5. Here habit 
formation, or solution learning, is con- 
ceived essentially as Thorndike sug- 
gested; but punishment is seen in more 
complex terms. Instead of simply re- 
versing the effect produced by past re- 
ward, punishment is here thought of as 
providing the basis for the conditioning 
of fear, which then produces conflict 
and, if the fear is strong enough, inhibi- 
tion. 

The details of this interpretation of 
punishment are shown at the right in 
Fig. 5. Here a problem situation or 
drive, Sz, produces an overt, instrumen- 
tal response, R;. R; is followed by pun- 
ishment, which is here represented as 
Sp. The punishment elicits a response 
R,, of which r;, or fear, is a component. 


Sv 
Sq Rj : —_ 
$---3(rp) 
Sr—R, 


$ 
Sq Rj: ~ 


:S—Sth 


a 


But when R; occurs, it not only pro- 
duces the extrinsic punishment, S,; it 
also produces a number of other stimuli, 
S, 5, S, which are inherently related to 
the occurrence of R;. The result: a part 
of the reaction produced by S,, namely 
fear, gets conditioned to these response- 
produced stimuli, s, s, s. Consequently, 
when S, recurs and the organism starts 
to perform R;, the resulting stimuli “re- 
mind” the organism of the antecedent 
punishment, i.e., cue off r,, which tends 
to inhibit Rj. 

Two-factor learning theory, original 
version, thus accepted Thorndike’s con- 
ception of habit formation but derived 
the phenomenon of punishment from 
fear conditioning, rather than attribut- 
ing it to a process which simply re- 
versed the effects of past reward. As 
has been shown, this theory of punish- 
ment involves the same principles as 
have been found most satisfactory for 
explaining so-called avoidance learning. 
In both instances, fear becomes condi- 


Sy 
Sq Rj: s~ SS. 
s--—S(r4) 
Sp—fp 


S 

ot 
Sd Rj: srt 

~~ 


Fic. 6. Schematic representation of revised two-factor theory. Here the changes produced 
in behavior by reward, as well as those produced by punishment, are derived from conditioning 


plus the feedback principle. 
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tioned to stimuli, either external or re- 
sponse-produced, and the organism then 
makes whatever type of adjustment will 
most effectively eliminate these stimuli 
and reduce the attendant fear. 
Revised two-factor theory is dia- 
gramed in Fig. 6. Here it is assumed 
that habit formation is a matter of con- 
ditioning no less than is punishment. If 
a stimulus, Sz, produces a given re- 
sponse R;, and if R, is followed by re- 
ward S,, then it is assumed that a part 
of the total response, R,, which is pro- 
duced by S, will become conditioned to 
the stimuli inherently connected with 
R;. Here the conditionable component 
of R, is r,, the “hope” (secondary re- 
inforcement) reaction; and it becomes 
connected to stimuli, s, s, s, just as fear 
does in the case of punishment. The 


result is that whenever R, starts to 

occur, it is 

inhibited. 
As revised, two-factor theory holds 


facilitated rather than 


that all learning is sign learning. The 
original version used sign learning to 
account only for the effects of punish- 
ment. Now it is proposed that the ef- 
fects of reward are likewise to be ex- 
plained in terms of sign learning, or 
conditioning. Thorndike’s original for- 
mulation of the Law of Effect had held 
that reward strengthens the bond be- 
tween S, and R; and that punishment 
weakens it. The present position is that 
neither rewards nor punishments affect 
this “connection,” in any neurological 
sense, and that the attendant learning 
is a matter of positive or negative 
meanings—hopes or fears—getting con- 
nected to response-produced stimuli. If 
on the basis of past experience, the feed- 
back from a given response is positive 
(hopeful), the response will be facili- 
tated; if the feedback is negative (fear- 
ful), the response will be inhibited; * 

6In this sentence, “positive” and “negative” 


are used, not as in cybernetics, but in a psy- 
chological sense. 
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but in neither case is it assumed that 
learning involves the S;—R, connection. 

Here it is assumed that S, drives, or 
motivates, behavior but that specific ac- 
tions are determined, not by the nature 
of specific S;—R, neurological bonds, 
but by the guiding (controlling) action 
of the r, and r; reactions which have be- 
come conditioned to response-produced 
stimuli (or their symbolic equivalents). 
It is not maintained that these two 
types of conditioning are necessarily 
the only kinds of learning that occur; 
but it is believed that they go a long 
way toward accounting for so-called se- 
lective learning and the determination 
of overt behavior in any given situation. 

As previously indicated, this way of 
thinking about the effects of reward and 
punishment articulates well with the 
more general aspects of field theory. It 
is not possible here to develop this 
relationship in any detail; but if the 
reader will consult a diagram published 
by Tolman some twenty years ago (39, 
p. 380), he will find a high degree of 
compatibility between it and the draw- 
ings shown in Fig. 6. One may say that 
Thorndike’s Law of Effect and Tolman’s 
sign-gestalt theory have seemed to be 
more different than they really are, 
mainly because one stressed certain fea- 
tures of a common process and neglected 
others, while the other theory did the 
reverse. By making the effects of pun- 
ishment and reward more fully explicit, 
as in Fig. 6, it is believed that a satis- 
factory reconciliation between habit the- 
ory and field theory can be achieved. 
Those conversant with psychoanalytic 
thought may also see a parallelism with 
the Freudian concepts of cathexis and 
anti-cathexis (8). 


CRITICISMS AND COMMENT 


Colleagues and students have kindly 
read a preliminary draft of this paper, 
Some of their criticisms follow: 





124 


1. Two “factors” or one? 


Your two processes reduce to one: S-S con- 
“tiguity. As you say, “In the present paper it 
is suggested that all learning is in the nature 
of sign learning” (p. 121). Why then speak of 
two processes? Both secondary motivation 
and secondary reinforcement (in your usage) 
develop out of the contiguous occurrence of 
two afferent processes—a neutral stimulus (in- 
teroceptive or exteroceptive) in conjunction 
with an increment or decrement in a drive- 
stimulus—and the first process thereby ac- 
quires some of the functional properties of the 
second. A unified S-S-contiguity formulation 
is not only neater, but more powerful as well, 
because it handles the case in which a neutral 
stimulus becomes the sign of another neutral 
stimulus, e.g., sensory preconditioning, associa- 
tion of ideas, and the like. It is more power- 
ful, too, because it doesn’t tie your learning 
theory to a drive-theory of motivation, which 
it seems to me must soon be abandoned in 
favor of a hedonic principle (eg. P. T. 
Young’s views). 


Although the distinction between sign 
learning and solution learning has been 
abandoned, the alternative formulation 


posits two basically different types of 
reinforcement: drive reduction and drive 


induction. Since these are the same as 
were involved in the original version of 
two-factor theory, it does not seem 
amiss to refer to the revised formula- 
tion as involving two (reinforcement) 
“factors.” 

What is implied by a “unified S-S- 
contiguity formulation” has never been 
entirely clear to the present writer. It 
is true that revised two-factor theory 
posits only sign, or “contiguity,” learn- 
ing; but it is S-S-r rather than S-S 
learning, in which the “r” is conditioned 
fear or hope (or some similar “attitude” 
or emotion). In a sense, revised two- 
factor theory is both an S-S theory and 
an S-r theory, but it is neither alone. 
As indicated, it is most accurately rep- 
resented as an S-S-r theory, which is 
believed capable of handling the salient 
facts of both “conditioning” and “habit 
formation.” 

Contiguity theory, as defined in the 
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above quotation, seems to make over 
what is merely a necessary condition for 
learning into the sufficient one. As Os- 
good has pointed out, virtually all theo- 
ries of learning agree “that contiguity 
is one necessary condition” (29a, p. 
321). But is it really the sufficient 
one? Think of the infinite number of 
cases of repeated temporal conjunction 
of stimuli in which learning apparently 
does mot occur. These negative in- 
stances make a pure stimulus-contiguity 
theory, not “powerful,” but impotent. 
Contiguity plus reinforcement (signifi- 
cance) seem to be essential for even the 
most rudimentary conception of learn- 
ing. So long as the evidence for sen- 
sory preconditioning or other empirical 
indications of learning without reinforce- 
ment (decremental or incremental) re- 
mains as scant and as ambiguous as it 
presently is, the S-S contiguity position 
remains unconvincing. 


2. Motivation vs. memory 


I . . . agree with your basic idea but think 
it a mistake to call it a theory of' learning; 
it is a theory of motivation of action but seems 
to me irrelevant to the formation and reten- 
tion of associations. I was recently served a 
very bad meal at a restaurant. I shall not go 
there again but I remember in detail the ar- 
rangement of the dining room, the appearance 
of the waitress, the flavor of the bad coffee, 
even the decorations on the dinner ware. 

Motivational theories were developed from 
studies of animals, in which it is very difficult 
to demonstrate memory without motivating 
action. But even with rats one can observe 
bits of behavior which suggests that in the 
course of training the animal learns many 
things unrelated to the motivation of the ex- 
periment. Like me, the animal learns his mo- 
tives but learns a great deal besides. I feel 
sure that the learning problem would be much 
clarified, if this distinction were emphasized. 
The key to learning is in the phenomena which 
Thorndike called ‘Belongingness,’ but I don’t 
seem able to make any progress there. 


Here the present writer has no very 
adequate answer. The basic issue is, 
again, one of fact: Can learning occur 
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on a “purely cognitive” basis or must 
there be a dynamic (motivational) ele- 
ment present? It would certainly be 
premature to deny the former possi- 
bility, but it is the latter assumption 
that has proven most fruitful research- 
wise. Moreover, an empirical study of 
word meanings reported recently by 
Osgood and Suci (30) indicates that 
the “good-bad” dimension in “semantic 
space” accounts for about 70 per cent 
of the total variance. The connotations 
of words (and other signs) are pretty 
clearly evaluative. It is when we come 
to the denotative (cognitive) function 
of signs that two-factor theory is most 
seriously challenged. While relevant, 
this problem lies beyond the scope of 
the present paper. 


3. Emotions other than hope and fear 


Are drive decrement (reward) and drive in- 
crement (punishment) the only reinforcers? 


We know that nausea and certain 
other emotional states, besides hope and 
fear, are conditionable (17). Appetite 
and lustful excitement, on the one hand 
(33), and frustration and anger, on the 
other,” present still other relatively un- 
explored problems. But rewards and 
hopes, and punishments and fears, seem 
to constitute the basic, though not nec- 
essarily the only, forms of reinforcement 
and motivation. 


4. Conditioned fear reduction: an 
enigma 


You have posited, following Miller, that fear 
is an unconditioned response to pain [see Fig. 
1]. You have also posited that secondary re- 
inforcement (of the hope variety) involves a 
conditioned alleviation of fear [Fig. 2], which 
occurs when the unconditioned stimulus (or 
primary drive) is stil present. Is it not some- 
what illogical to posit a conditioned reaction 
that involves the lessening of an unconditioned 
reaction ? 


7 Lawson, R., & Marx, M. H. Frustration: 
theories and experiments (to be published). 
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This is a nice point and one that may 
throw light upon some heretofore rather 
puzzling observations. The assumption 
which must obviously be made is that 
the fear aroused by a strong primary 
drive is partly reflexive (unconditioned) 
and partly learned (conditioned). Be- 
cause drives commonly start out at low 
intensity and become stronger, they 
often have a cue function, in addition 
to their unconditional capacity for 
arousing fear. Therefore, we may infer 
that a “safety” signal or “promise” of 
relief can counteract the fear accom- 
panying a strong drive only to the ex- 
tent that the fear is learned rather than 
reflexive. Here may lie, in part, the ex- 
planation of why it is relatively easy to 
give secondary-reinforcement potential 
to stimuli that are associated with the 
reduction of hunger or thirst and harder 
to give it to a stimulus associated with 
termination of a more painful drive such 
as electric shock. This line of thought 
clearly calls for further development. 


5. Skill and discrimination 


Very often the remark has been 
made: “Granted that much, perhaps 
most, learning is sign learning, is it not 
probable that skills involve a form of 
purely ‘motor’ learning?” Keller (14) 
has offered a quite satisfactory answer 
to this question in his hypothesis that 
the perfection of motor skills is a matter 
of increasing refinement of discrimina- 
tion between the sensory feedback from 
right and not-quite-right muscular per- 
formances (see also 1 and 9). What- 
ever the facts may ultimately prove to 
be, Keller’s hypothesis seems logically 
adequate, within the present theoretical 
framework. 


6. Response initiation: another enigma 


Whatever you decide to do about the first 
problem [Paragraph 1], you still need another 
process (though not necessarily a learning 
process) to account for selective learning. As 
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it stands, your principle of secondary reinforce- 
ment is not enough. The fact that stimuli 
(intero- or exteroceptive) have been associated 
with hunger-reduction and thereby acquire a 
certain positive valence does not explain how 
these stimuli, even if they occur before the in- 
strumental response which accomplishes the 
need reduction, come to elicit that response. 
How does “hope” lead to appropriate action? 
Once “R, starts to occur” (p. 123, italics mine), 
it can be inhibited or facilitated by conditioned 
drive increments or decrements—an assump- 
tion which should be set off more clearly, by 
the way—but why does it start? One possi- 
bility is that the organism is constantly scan- 
ning its response repertoire, with scanning rate 
proportional to drive level. Another possi- 
bility is to return to a process of stimulus- 
response connection. Neither appeals to me. 
But the problem of response elicitation must 
be recognized. 


If one assumes, with Tolman, that 
learning consists solely of the establish- 
ment of new cognitions, then the issue 
cf response initiation is indeed a serious 
one. As Guthrie (10) has observed: 


In his concern with what goes on in the rat’s 
mind, Tolman has neglected to predict what 
the rat will do. So far as the theory is con- 
cerned the rat is left buried in thought; if it 
gets to the food box at the end of the maze 
that is its concern, not the concern of the 
theory (10, p. 143). 


Revised two-factor theory, in positing 
hope and fear as the principal products 
of learning, is surely a good deal more 
dynamic and less susceptible to the fore- 
going criticism than is sign-gestalt the- 
ory. In fact, one reader of the present 
paper has said: 


One of the significant features of your new 
theory, which is not mentioned by you, is that 
it contains the seed, or the starting point, of a 
theory of behavior as such, of which a learn- 
ing or habit theory is merely an offshoot. 
Your Diagram #6, although I have some defi- 
nite criticisms of it, suggests to me a general 
paradigm of behavior. It is when it refers to 
recurring similar situations that it is also ap- 
plicable to learning. Your willingness to deal 
with meanings rather than S-R connections 
and bonds gives your position a general ap- 
plicability. 
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The reader first cited nevertheless has 
a point. If, as posited, behavior is 
constantly guided (inhibited and facili- 
tated) by the sensory consequences 
(feedback) of behavior and the mean- 
ing (motivational) states they then pro- 
duce, there is certainly the anterior 
question of how behavior gets started. 
Some initial, or initiating, drive is, of 
course, assumed; but the question is, 
Why should it initiate one response 
rather than any other? 

Some extremely difficult problems are 
unquestionably involved here, but the 
arguments against the concept of scan- 
ning are not so convincing to the present 
writer as to the correspondent cited. 
Living organisms, when conscious and 
motivated, are constantly “scanning” 
their environment, with their extero- 
ceptors, for “leads” or cues as to what 
to do (and not do). When the environ- 
ment is cue-improvised, as it often is in 
maze experiments, the organism may be 
reduced to searching, or “scanning,” for 
proprioceptive leads. This is sometimes 
done by performing certain responses, 
overtly but im miniature, as in VTE 
behavior; or, in higher organisms, the 
process may involve symbolic activities 
which are entirely covert. How an or- 
ganism plays his receptors or how he 
engages in “pure-stimulus acts” (Hull, 
11) is admittedly a mystery. But the 
Why is obvious: the organism is “look- 
ing” and “feeling” around for signs that 
will either release action which may be 
gratifying or will block action which 
might be harmful. Therefore, as of the 
present, it would appear that the con- 
cept of scanning provides what is per- 
haps our most promising lead in this 
connection. More detailed attention 
will be given to this problem at another 
time. 


SUMMARY 


Two-factor learning theory, in its 
original version, held that there are two 
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basically different learning processes: 
sign ‘earning, conditioning, or stimulus 
substitution and solution learning, trial 
and error, or response substitution. 

This point of view gained consider- 
able strength from the fact that it 
handled the facts of punishment and 
avoidance learning more adequately 
than did the theories of Thorndike, 
Pavlov, and Hull. However, it was 
weak in that it continued to accept, 
essentially unmodified, Thorndike’s con- 
ception of habit formation, as a matter 
of simple S-R “bonding”; and it did 
not take full cognizance of the emerg- 
ing research on secondary reinforcement. 

In the present paper, earlier thinking 
about fear conditioning and the rein- 
forcing effects of fear reduction is ex- 
tended in such a way as to provide, 
within the same conceptual framework, 
a new interpretation of secondary re- 
inforcement. And with this step taken, 
it is found that a radical modification 
of the traditional concept of habit logi- 
cally emerges. 

The original version of two-factor the- 
ory differs from Thorndike’s Law of Ef- 
fect in holding that punishment, rather 
than directly weakening or “stamping- 
out” a neural connection, or “bond,” 
achieves its action by causing fear to 
become conditioned to response-corre- 
lated stimuli, so that when the organism 
subsequently starts to repeat the pun- 
ished response, fear is aroused, which 
causes conflict and response inhibition, 
or at least modification. 

Revised two-factor theory, as here 
proposed, holds that habit formation is 
likewise dependent upon feedback, just 
as punishment is. If fear becomes con- 
ditioned to stimuli which are associated 
with a response that has been followed 
by punishment (drive increment), then 
hope (secondary reinforcement) be- 
comes likewise connected to stimuli 
which are associated with a response 
that has been followed by reward (drive 
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decrement). “Positive” feedback, rather 
than a motive-behavior “bond,” is thus 
hypothesized as the essence of habit. 
Such a position readily articulates with 
modern servo-theory, field theory, and 
parts of psychoanalytic theory. Al- 
though employing different terminology, 
a number of other contemporary writers, 
it seems, are moving toward a somewhat 
similar point of view. 

Examples of experimental evidence 
supporting this revised view of habit are 
briefly (and quite incompletely) cited, 
along with some complications and un- 
solved problems. 
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A growing interest in decision making 
in psychology is evidenced by the recent 
publication of Edwards’ review article 
in the Psychological Bulletin (1) and 
the Santa Monica Conference volume, 
Decision Processes (7). In this work, 
much attention has been focused on the 
characterization of rational choice, and 
because the latter topic has been a cen- 
tral concern in economics, the theory of 
decision making has become a natural 
meeting ground for psychological and 
economic theory. 

A comparative examination of the 
models of adaptive behavior employed 
in psychology (e.g., learning theories), 
and of the models of rational behavior 


employed in economics, shows that in 
almost all respects the latter postulate 
a much greater complexity in the choice 
mechanisms, and a much larger capacity 
in the organism for obtaining informa- 
tion and performing computations, than 


do the former. Moreover, in the lim- 
ited range of situations where the pre- 
dictions of the two theories have been 
compared (see [7, Ch. 9, 10, 18]), the 
learning theories appear to account for 
the observed behavior rather better than 
do the theories of rational behavior. 
Both from these scanty data and from 
an examination of the postulates of the 
economic models it appears probable 
that, however adaptive the behavior of 
organisms in learning and choice situa- 
tions, this adaptiveness falls far short 
of the ideal of “maximizing” postulated 


1] am indebted to Allen Newell for numer- 
ous enlightening conversations on the subject 
of this paper, and to the Ford Foundation for 
a grant that permitted me leisure to com- 
plete it. 


in economic theory. Evidently, organ- 
isms adapt well enough to “satisfice”; 
they do not, in general, “optimize.” 

If this is the case, a great deal can 
be learned about rational decision mak- 
ing by taking into account, at the out- 
set, the limitations upon the capacities 
and complexity of the organism, and by 
taking account of the fact that the en- 
vironments to which it must adapt pos- 
sess properties that permit further sim- 
plication of its choice mechanisms. It 
may be useful, therefore, to ask: How 
simple a set of choice mechanisms can 
we postulate and still obtain the gross 
features of observed adaptive choice be- 
havior? 

In a previous paper (6) I have put 
forth some suggestions as to the kinds 
of “approximate” rationality that might 
be employed by an organism possessing 
limited information and limited compu- 
tational facilities. The suggestions were 
“hypothetical” in that, lacking definitive 
knowledge of the human decisional proc- 
esses, we can only conjecture on the ba- 
sis of our everyday experiences, our in- 
trospection, and a very limited body of 
psychological literature what these proc- 
esses are. The suggestions were in- 
tended, however, as empirical state- 
ments, however tentative, about some 
of the actual mechanisms involved in 
human and other organismic choice.” 

Now if an organism is confronted 


2 Since writing the paper referred to I have 
found confirmation for a number of its hy- 
potheses in the interesting and significant 
study, by A. de Groot, of the thought proc- 
esses of chess players (3). I intend to discuss 
the implications of these empirical findings for 
my model in another place. 
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with the problem of behaving approxi- 
mately rationally, or adaptively, in a 
particular environment, the kinds of 
simplifications that are suitable may de- 
pend not only on the characteristics— 
sensory, neural, and other—of the or- 
ganism, but equally upon the structure 
of the environment. Hence, we might 
hope to discover, by a careful examina- 
tion of some of the fundamental struc- 
tural characteristics of the environment, 
some further clues as to the nature of 
the approximating mechanisms used in 
decision making. This is the line of at- 
tack that will be adopted in the present 
paper. 

The environment we shall discuss ini- 
tially is perhaps a more appropriate one 
for a rat than for a human. For the 
term environment is ambiguous. We 
are not interested in describing some 
physically objective world in its to- 
tality, but only those aspects of the to- 
tality that have relevance as the “life 
space” of the organism considered. 
Hence, what we call the “environment” 
will depend upon the “needs,” “drives,” 
or “goals” of the organism, and upon 
its perceptual apparatus. 


THE ENVIRONMENT OF THE ORGANISM 


We consider first a simplified (per- 
haps “simple-minded’”’) organism that 
has a single need—food—and is ca- 
pable of three kinds of activity: resting, 
exploration, and food getting. The pre- 
cise nature of these activities will be 


explained later. The organism’s life 
space may be described as a surface 
over which it can locomote. Most of 
the surface is perfectly bare, but at iso- 
lated, widely scattered points there are 
little heaps of food, each adequate for 
a meal. 

The organism’s vision permits it to 
see, at any moment, a circular portion 
of the surface about the point in which 
it is standing. It is able to move at 
some fixed maximum rate over the sur- 
face. It metabolizes at a given aver- 
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age rate and is able to store a certain 
amount of food energy, so that it needs 
to eat a meal at certain average inter- 
vals. It has the capacity, once it sees 
a food heap, to proceed toward it at the 
maximum rate of locomotion. The prob- 
lem of rational choice is to choose its 
path in such a way that it will not 
starve. 

Now I submit that a rational way for 
the organism to behave is the following: 
(a) it explores the surface at random, 
watching for a food heap; (4) when it 
sees one, it proceeds to it and eats (food 
getting); (c) if the total consumption 
of energy during the average time re- 
quired, per meal, for exploration and 
food getting is less than the energy of 
the food consumed in the meal, it can 
spend the remainder of its time in 
resting.* 

There is nothing particularly remark- 
able about this description of rational 
choice, except that it differs so sharply 
from the more sophisticated models of 
human rationality that have been pro- 
posed by economists and others. Let 
us see what it is about the organism 
and its environment that makes its 
choice so simple. 

1. It has only a single goal: food. 
It does not need to weigh the respective 
advantages of different goals. It re- 
quires no “utility function” or set of 
“indifference curves” to permit it to 
choose between alternatives. 

2. It has no problem of maximiza- 
tion. It needs only to maintain a cer- 
tain average rate of food intake, and 
additional food is of no use to it. In 


3A reader who is familiar with W. Grey 
Walter’s mechanical turtle, Machina specu- 
latrix (8), will see as we proceed that the de- 
scription of our organism could well be used 
as a set of design specifications to assure the 
survival of his turtle in an environment 
sparsely provided with battery chargers. Since 
I was not familiar with the structure of the 
turtle when I developed this model, there are 
some differences in their behavior—but the 
resemblance is striking. 
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the psychologist’s language, it has a 
definite, fixed aspiration level, and its 
successes or failures do not change its 
aspirations. 

3. The nature of its perceptions and 
its environment limit sharply its plan- 
ning horizon. Since the food heaps are 
distributed randomly, there is no need 
for pattern in its searching activities. 
Once it sees a food heap, it can follow 
a definite “best” path until it reaches it. 

4. The nature of its needs and envi- 
ronment create a very natural separa- 
tion between “means” and “ends.” Ex- 
cept for the food heaps, one point on 
the surface is as agreeable to it as an- 
other. Locomotion has significance only 
as it is a means to reaching food.* 

We shall see that the first point is not 
essential. As long as aspirations are 
fixed, the planning horizon is limited, 
and there is a sharp distinction between 
means and ends, the existence of multi- 
ple goals does not create any real diffi- 
culties in choice. The real complica- 
tions ensue only when we relax the 
last three conditions; but to see clearly 
what is involved, we must formulate 
the model a little more precisely. 


PERCEPTUAL POWERS, STORAGE 
CAPACITY, AND SURVIVAL 


It is convenient to describe the organ- 
ism’s life space not as a continuous 
surface, but as a branching system of 
paths, like a maze, each branch point 


representing a choice point. We call 
the selection of a branch and locomotion 
to the next branch point a “move.” At 
a small fraction of the branch points are 
heaps of food. 

Let p, 0<p<1, be the percentage of 
branch points, randomly distributed, at 


4It is characteristic of economic models 
of rationality that the distinction between 
“means” and “ends” plays no essential role in 
them. This distinction cannot be identified 
with the distinction between behavior alterna- 
tives and utilities, for reasons that are set 
forth at some length in the author’s Adminis- 
trative Behavior, Ch. 4 and 5 (5). 
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which food is found. Let d be the aver- 
age number of paths diverging from each 
branch point. Let » be the number of 
moves ahead the organism can see. 
That is, if there is food at any of the 
branch points within » moves of the 
organism’s present position, it can select 
the proper paths and reach it. Finally 
let H be the maximum number of moves 
the organism can make between meals 
without starving. 

At any given moment, the organism 
can see d branch points at a distance of 
one move from his present position, d* 
points two moves away, and in general, 
d* points k moves away. In all, it can 


see d + d?+ pares 1 2" - Y 


points. When it chooses a branch and 
makes a move, d’ new points become 
visible on its horizon. Hence, in the 
course of m moves, md* new points 
appear. Since it can make a maximum 
of H moves, and since v of these will be 
required to reach food that it has dis- 
covered on its horizon, the probability, 
Q = 1 — P, that it will mol survive will 
be equal to the probability that no food 
points will be visible in (H — v) moves. 
(If p is small, we can disregard the 
possibility that food will be visible inside 
its planning horizon on the first move.) 
Let p be the probability that none of 
the d* new points visible at the end of a 
particular move is a food point. 


p= (1— p)*. [2.1] 


Then: 


1—P=Q=p®™» = (1— p)@F, 
[2.2] 


We see that the survival chances, from 
meal to meal, of this simple organism 
depend on four parameters, two that 
describe the organism and two the en- 
vironment: p, the richness of the environ- 
ment in food; d, the richness of the en- 
vironment in paths; H, the storage 
capacity of the organism; and 2, the 
range of vision of the organism. 
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To give some impression of the magni- 
tudes involved, let us assume that p is 
1/10,000, (H — v) is 100, d is 10 and 
v is 3. Then the probability of seeing 
a new food point after a move is 1 — p 
= 1— (1 — p) ~ 880/10,000, and the 
probability of survival is P = 1 — p'™ 
~ 9999/10,000. Hence there is in this 
case only one chance in 10,000 that the 
organism will fail to reach a food point 
before the end of the survival interval. 
Suppose now that the survival time 
(H — x) is increased one-third, that is, 
from 100 to 133. Then a similar com- 
putation shows that the chance of starva- 
tion is reduced to less than one chance 
in 100,000. A one-third increase in v 
will, of course, have an even greater 
effect, reducing the chance of starvation 
from one in 10~ to one in 10™. 

Using the same values, p = .0001, and 
(H — v) = 100, we can compute the 
probability of survival if the organ- 
ism behaves completely randomly. In 
this case P’ = [1 — (1 — p)'] = .009. 
From these computations, we see that 
the organism’s modest capacity to per- 
form purposive acts over a short planning 
horizon permits it to survive easily in an 
environment where random _ behavior 
would lead to rapid extinction. A sim- 
ple computation shows that its percep- 
tual powers multiply by a factor of 880 
the average speed with which it discovers 
food. 

If p, d, and v are given, and in addition 
we specify that the survival probability 
must be greater than some number close 
to unity (P > 1 — e), we can compute 
from [2.2] the corresponding minimum 
value of H: 


log (1— P) = (H—v)logp [2.3] 


[2.4] 


log € 

So 04+. 

log p 

For example, if p = .95 and e = 10~", 
then log p = — .022, log e = — 10 and 
(H — v) > 455. The parameter, H, can 
be interpreted as the “storage capacity” 
of the organism. That is, if the organ- 
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ism metabolizes at the rate of a units 
per move, then a storage of aH food 
units, where H is given by Equation 4, 
would be required to provide survival at 
the specified risk level, e. 

Further insight into the meaning of H 
can be gained by considering the average 
number of moves, M, required to dis- 
cover food. From Equation 1, the prob- 
ability of making (k — 1) moves without 
discovering food, and then discovering 
it on the k* is: 


P, = (1 — p)p*”. [2.5] 


Hence, the average number of moves, 
M, required to discover food is: 


M =Zk(1 — p)p* 
k=l 


(1 — p) 1 
“a-9 G-y 24 


Since (1 — p) is the probability of dis- 
covering food in any one move, M is the 
reciprocal of this probability. Combin- 
ing [2.3] and [2.6], we obtain: 


M___logp 1 
H-—vwv (1—p)log (1 — P) 





[2.7] 
Since p is close to one, log. p= (1 — p), 
and [2.7] reduces approximately to: 


M 7 1 
H—-—vw log. (1 — P) 





[2.8] 


For example, if we require (1 — P) 
= ¢e< 10‘ (one chance in 10,000 of 
starvation), then M/(H — v) < .11. For 
this survival level we require food storage 
approximately equal to a(v+ 9M)— 
food enough to sustain the organism for 
nine times the period required, on the 
average, to discover food, plus the period 
required to reach the food.® 


5T have not discovered any very satisfactory 
data on the food storage capacities of animals, 
but the order of magnitude suggested above for 
the ratio of average search time to storage capac- 
ity is certainly correct. It may be noted that, 
in some cases at least, where the “food” sub- 
stance is ubiquitous, and hence the search time 
negligible, the storage capacity is also small. 
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CHOICE MECHANISMS FOR 
MULTIPLE GOALS 


We consider now a more complex 
organism capable of searching for and 
responding to two or more kinds of goal 
objects. In doing this we could intro- 
duce any desired degree of complexity 
into the choice process ; but the interest- 
ing problem is how to introduce multiple 
goals with a minimum complication of 
the process—that is, to construct an 
organism capable of handling its decision 
problems with relatively primitive choice 
mechanisms. 

At the very least, the presence of two 
goals will introduce a consistency require- 
ment—the time consumed in attaining 
one goal will limit the time available for 
pursuit of the other. But in an environ- 
ment like the one we have been consider- 
ing, there need be no further relationship 
between the two goals. In our original 
formulation, the only essential stipula- 
tion was that H, the storage capacity, be 


adequate to maintain the risk of starva- 
tion below a stipulated level (1 — P). 
Now we introduce the additional stipula- 
tion that the organism should only de- 
vote a fraction, \, of its time to food- 
seeking activities, leaving the remaining 


fraction, 1 — \, toother activities. This 
new stipulation leads to a requirement 
of additional storage capacity. 

In order to control the risk of starving, 
the organism must begin its exploration 
for food whenever it has reached a level 
of H periods of food storage. If it has 
a total storage of (u+ H) periods of 
food, and if the food heaps are at least 
a(u + #) in size, then it need begin the 
search for food only uw periods after its 
last feeding. But the food research will 
require, on the average, M periods. 





Thus, in terrestrial animals there is little oxygen 
storage and life can be maintained in the absence 
of air for only a few minutes. I am not arguing 
as to which way the causal arrow runs, but only 
that the organisms, in this respect, are adapted 
to their environments and do not provide storage 
that is superfluous. 
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Hence, if a hunger threshold is estab- 
lished that leads the organism to begin 
to explore u periods after feeding, we 
will have: 

d We [3.1] 

Hence, by making u sufficiently large, 
we can make X as small as we please. 
Parenthetically, it may be noted that 
we have here a close analogue to the very 
common two-bin system of controlling 
industrial inventories. The primary 
storage, H, is a buffer stock to meet 
demands pending the receipt of new 
orders (with risk, 1 — P, of running 
out); the secondary storage, u, defines 
the “order point”; and » + M is the 
avere~e order quantity. The storage u 
is fixed to balance storage “costs” against 
the cost (in this case, time pressure) of 
too frequent reordering. 

If food and the second goal object 
(water, let us say) are randomly and 
independently distributed, then there are 
no important complications resulting 
from interference between the two activ- 
ities. Designate by the subscript 1 the 
variables and parameters referring to 
food getting (e.g., u: is the food threshold 
in periods), and by the subscript 2 the 
quantities referring to water seeking. 
The organism will have adequate time 
for both activities if A; + A: < 1. 

Now when the organism reaches either 
its hunger or thirst threshold, it will 
begin exploration. We assume that if 
either of the goal objects becomes visible, 
it will proceed to that object and satisfy 
its hunger or thirst (this will not increase 
the number of moves required, on the 
average, to reach the other object); but 
if both objects become visible at the 
same time, and if S; and S2 are the 
respective quantities remaining in stor- 
age at this time, then it will proceed to 
food or water as M/S, is greater or less 
than M2/S». This choice will maximize 
its survival probability. What is re- 
quired, then, is a mechanism that pro- 
duces a drive’proportional to M;/S;. 


M 
= 
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A priority mechanism of the kind just 
described is by no means the only or 
simplest one that can be postulated. 
An even simpler rule is for the organism 
to persist in searching for points that 
will satisfy the particular need that first 
reached its threshold and initiated ex- 
ploratory behavior. This is not usually 
an efficient procedure, from the stand- 
point of conserving goal-reaching time, 
but it may be entirely adequate for an 
organism generously endowed with stor- 
age capacity. 

We see that an organism can satisfy 
a number of distinct needs without re- 
quiring a very elaborate mechanism for 
choosing among them. In particular, 
we do not have to postulate a utility 
function or a “‘marginal rate of substitu- 
tion.” 

We can go even further, and assert 
that a primitive choice mechanism is 
adequate to take advantage of important 
economies, if they exist, which are deriv- 
able from the interdependence of the 
activities involved in satisfying the dif- 
ferent needs. For suppose the organism 
has » needs, and that points at which he 
can satisfy each are distributed randomly 
and independently through the environ- 
ment, each with the same probability, p. 
Then the probability that no points 
satisfying any of the needs will be visible 
on a particular move is p", and the mean 
number of moves for discovery of the 
first need-satisfying point is: 

1 
G—.*)" [3.2] 

Suppose that the organism begins to 
explore, moves to the first need-satisfying 
point it discovers, resumes its explora- 
tion, moves to the next point it discovers 
that satisfies a need other than the one 
already satisfied, and so on. Then the 
mean time required to search for all n 
goals will be: 

M,= Ma + My-1 + °*° 
- 1 n 
a-f <a 


=i 


mM, = 





[3.3] 
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In particular, if p is close to one, that 
is, if need-satisfying points are rare, we 
will have: 


oe. 
G~f 
1 1 


(1 — 2) Si 


M,— Mi ” 
M, 


M,=~M,> :. 


tl 


[3.5] 


Now substituting particular values for 
nm in [3.5] we get: M:=3/2 Mj; 
M; = 11/6 M,; M,= 25/12 M,, etc. 
We see that if the organism has two 
separate needs, its exploration time will 
be only 50 per cent greater than—and 
not twice as great as—if it has only one 
need ; for four needs the exploration time 
will be only slightly more than twice as 
great as for a single need, and so on. 
A little consideration of the program just 
described will show that the joint ex- 
ploratory process does not reduce the 
primary storage capacity required by the 
organism but does reduce the secondary 
storage capacity required. As a matter 
of fact, there would be no necessity at 
all for secondary storage. 

This conclusion holds only if the need- 
satisfying points are independently dis- 
tributed. If there is a negative correla- 
tion in the joint distribution of points 
satisfying different needs, then it may 
be economical for the organism to pursue 
its needs separately, and hence to have 
a simple signaling mechanism, involving 
secondary storage, to trigger its several 
exploration drives. This point will be 
developed further in the next section. 

A word may be said here about 
“avoidance needs.”” Suppose that cer- 
tain points in the organism’s behavior 
space are designated as “dangerous.” 
Then it will need to avoid those paths 
that lead to these particular points. If 
r per cent of all points, randomly dis- 
tributed, are dangerous, then the number 
of available paths, among those visible 





RATIONAL CHOICE AND ENVIRONMENT STRUCTURE 


at a given move, will be reduced to 
(1—r)d*. Hence, p’ = (1 — p)@-# 
will be smaller than p (Equation 2.1), 
and M (Equation 2.6) will be correspond- 
ingly larger. Hence, the presence of 
danger points simply increases the aver- 
age exploration time and, consequently, 
the required storage capacity of the 
organism. 


FURTHER SPECIFICATION OF THE 
ENVIRONMENT: CLUES 


In our discussion up to the present 
point, the range of the organism’s an- 
ticipations of the future has been lim- 
ited by the number of behavior alterna- 
tives available to it at each move (d), 
and the length of the “vision” (v). It 
is a simple matter to introduce into the 
model the consequences of several types 
of learning. An increase in the reper- 


toire of betavior alternatives or in the 
length of vision can simply be repre- 
sented by changes in d and v, respec- 


tively. 

A more interesting possibility arises if 
the food points are not distributed com- 
pletely at random, and if there are clues 
that indicate whether a particular inter- 
mediate point is rich or poor in paths 
leading to food points. First, let us 
suppose that on the path leading up to 
each food point the & preceding choice 
points are marked with a food clue. 
Once the association between the clue 
and the subsequent appearance of the 
food point is learned by the organism, 
its exploration can terminate with the 
discovery of the clue, and it can follow 
a determinate path from that point on. 
This amounts to substituting v’ = (v 
+ k) for v. 

A different kind of clue might operate 
in the following fashion. Each choice 
point has a distinguishable characteristic 
that is associated with the probability 
of encountering a food point if a path is 
selected at random leading out of this 
choice point. The organism can then 
select at each move the choice point 
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with the highest probability. If only 
certain choice points are provided with 
such clues, then a combination of ran- 
dom and systematic exploration can be 
employed. Thus the organism may be 
led into “regions” where the probability 
of goal attainment is high relative to 
other regions, but it may have to ex- 
plore randomly for food within a given 
region. 

A concrete example of such behavior 
in humans is the “position play” char- 
acteristic of the first phase of a chess 
game. The player chooses moves on 
the basis of certain characteristics of re- 
sulting positions (e.g., the extent to 
which his pieces are developed). Cer- 
tain positions are adjudged richer in at- 
tacking and defensive possibilities than 
others, but the original choice may in- 
volve no definite plan for the subsequent 
action after the “good” position has 
been reached. 

Next, we turn to the problem of 
choice that arises when those regions of 
the behavior space that are rich in 
points satisfying one need (/; is high 
in these regions) are poor in points 
satisfying another need (2 is low in 
these same regions). In the earlier case 
of goal conflict (two or more points 
simultaneously visible mediating differ- 
ent needs), we postulated a priority 
mechanism that amounted to a mecha- 
nism for computing relative need in- 
tensity and for responding to the more 
intense need. In the environment with 
clues, the learning process would need 
to include a conditioning mechanism 
that would attach the priority mecha- 
nism to the response to competing clues, 
as well as to the response to competing 
visible needs. 

Finally, we have thus far specified 
the environment in such a way that 
there is only one path leading to each 
point. Formally, this condition can al- 
ways be satisfied by representing as two 
or more points any point that can be 
reached by multiple paths. For some 
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purposes, it might be preferable to 
specify an environment in which paths 
converge as well as diverge. This can 
be done without disturbing the really 
essential conditions of the foregoing 
analysis. For behavior of the sort we 
have been describing, we require of the 
environment only: 

1. that if a path is selected com- 
pletely at random the probability of 
survival is negligible; 

2. that there exist clues in the envi- 
ronment (either the actual visibility of 
need-satisfying points or anticipatory 
clues) which permit the organism, suffi- 
ciently frequently for survival, to select 
specific paths that lead with certainty, 
or with very high probability, to a need- 
satisfying point. 


CONCLUDING COMMENTS ON 
MULTIPLE GOALS 


The central problem of this paper has 
been to construct a simple mechanism 
of choice that would suffice for the be- 
havior of an organism confronted with 
multiple goals. Since the organism, like 
those of the real world, has neither the 
senses nor the wits to discover an 
“optimal” path—even assuming the con- 
cept of optimal to be clearly defined— 
we are concerned only with finding a 
choice mechanism that will lead it to 
pursue a “satisficing” path, a path that 
will permit satisfaction at some speci- 
fied level of all of its needs. 

Certain of the assumptions we have 
introduced to make this possible repre- 
sent characteristics of the organism. 
(a) It is able to plan short purposive 
behavior sequences (of length not ex- 
ceeding v), but not long sequences. (0) 
Its needs are not insatiable, and hence 
it does not need to balance marginal in- 
crements of satisfaction. If ail its needs 
are satisfied, it simply becomes inactive. 
(c) It possesses sufficient storage ca- 
pacity so that the exact moment of 
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satisfaction of any particular need is 
not critical. 

We have introduced other assump- 
tions that represent characteristics of 
the environment, the most important 
being that need satisfaction can take 
place only at “rare” points which (with 
some qualifications we have indicated) 
are distributed randomly. 

The most important conclusion we 
have reached is that blocks of the or- 
ganism’s time can be allocated to activi- 
ties related to individual needs (sepa- 
rate means-end chains) without creat- 
ing any problem of over-all allocation 
or coordination or the need for any gen- 
eral “utility function.” The only scarce 
resource in the situation is time, and its 
scarcity, measured by the proportion of 
the total time that the organism will 
need to be engaged in some activity, 
can be reduced by the provision of 
generous storage capacity. 

This does not mean that a more effi- 


cient procedure cannot be constructed, 
from the standpoint of the total time 
required to meet the organism’s needs. 
We have already explored some simple 
possibilities for increasing efficiency by 
recognizing complementarities among ac- 
tivities (particularly the exploration ac- 


tivity). But the point is that these 
complications are not essential to the 
survival of an organism. Moreover, if 
the environment is so constructed (as 
it often is in fact) that regions rich in 
possibilities for one kind of need satis- 
faction are poor in possibilities for other 
satisfactions, such efficiencies may not 
be available. 

It may be objected that even rela- 
tively simple organisms appear to con- 
form to efficiency criteria in their be- 
havior, and hence that their choice 
mechanisms are much more elaborate 
than those we have described. A rat, 
for example, learns to take shorter 
rather than longer paths to food. But 
this observation does not affect the cen- 





RATIONAL CHOICE AND ENVIRONMENT STRUCTURE 


tral argument. We can introduce a 
mechanism that leads the organism to 
choose time-conserving paths, where 
multiple paths are available for satis- 
fying a given need, without any assump- 
tion of a mechanism that allocates time 
among different needs. The former 
mechanism simply increases the “slack” 
in the whole system, and makes it even 
more feasible to ignore the comple- 
mentarities among activities in program- 
ming the over-all behavior of the or- 
ganism. 

This is not the place to discuss at 
length the application of the model to 
human behavior, but a few general 
statements may be in order. First, the 
analysis has been a static one, in the 
sense that we have taken the organ- 
ism’s needs and its sensing and plan- 
ning capacities as given. Except for a 
few comments, we have not considered 
how the organism develops needs or 
learns to meet them. One would con- 


jecture, from general observation and 
from experimentation with aspiration 
levels, that in humans the balance be- 
tween the time required to meet needs 
and the total time available is main- 
tained by the raising and lowering of 


aspiration levels. I have commented 
on this point at greater length in my 
previous paper.® 

Second, there is nothing about the 
model that implies that the needs are 
physiological and innate rather than 
sociological and acquired. Provided that 
the needs of the organism can be speci- 
fied at any given time in terms of the 
aspiration levels for the various kinds 
of consummatory behavior, the model 
can be applied. 

The principal positive implication of 
the model is that we should be skeptical 
in postulating for humans, or other 


6 See (6, pp. 111, 117-18). For an experi- 
ment demonstrating the adjustment of the 
rat’s aspiration levels to considerations of re- 
alizability, see Festinger (2). 
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organisms, elaborate mechanisms for 
choosing among diverse needs. Com- 
mon denominators among needs may 
simply not exist, or may exist only in 
very rudimentary form; and the na- 
ture of the organism’s needs in relation 
to the environment may make their 
nonexistence entirely tolerable. 

There is some positive evidence bear- 
ing on this point in the work that has 
been done on conflict and frustration. 
A common method of producing con- 
flict in the laboratory is to place the 
organism in a situation where: (a) it is 
stimulated to address itself simultane- 
ously to alternative goal-oriented be- 
haviors, or (6) it is stimulated to a 
goal-oriented behavior, but restricted 
from carrying out the behaviors it usu- 
ally evinces in similar natural situa- 
tions. This suggests that conflict may 
arise (at least in a large class of situa- 
tions) from presenting the animal with 
situations with which it is not “pro- 
grammed” to deal. Conflict of choice 
may often be equivalent to an absence 
of a choice mechanism in the given 
situation. And while it may be easy to 
create such situations in the labora- 
tory, the absence of a mechanism to 
deal with them may simply reflect the 
fact that the organism seldom encoun- 
ters equivalent situations in its natural 
environment.” 


CONCLUSION 


In this paper I have attempted to 
identify some of the structural charac- 
teristics that are typical of the “psy- 
chological” environments of organisms. 
We have seen that an organism in an 
environment with these characteristics 
requires only very simple perceptual and 
choice mechanisms to satisfy its several 
needs and to assure a high probability 
of its survival over extended periods of 


7 See, for example, Neal E. Miller, “Experi- 
mental Studies of Conflict” in (4, Ch. 14). 
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time. In particular, no “utility func- 
tion” needs to be postulated for the or- 
ganism, nor does it require any elabo- 
rate procedure for calculating marginal 
rates of substitution among different 
wants. 

The analysis set forth here casts seri- 
ous doubt on the usefulness of current 
economic and statistical theories of ra- 
tional behavior as bases for explaining 
the characteristics of human and other 
organismic rationality. It suggests an 
alternative approach to the description 
of rational behavior that is more closely 
related to psychological theories of per- 
ception and cognition, and that is in 
closer agreement with the facts of be- 
havior as observed in laboratory and 
field. 
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As the contrast between a foveally 
viewed figure and its background is 
gradually increased, the appearance of 
the figure passes through a number of 
stages before it emerges with an unmis- 
takable shape (2, 5, 12). Im the case 
of an evenly illuminated figure viewed 
against a homogeneously dark ground, 
the most that can be seen at very low 
contrast is a blurred patch of light. 
During this initial perceptual stage 
which occurs at the threshold for light, 
the light patch appears formless (12) 
or, at the most, vaguely circular (26), 
irrespective of the true shape of the fig- 
ure. At a brightness approximately 15 
times as great as that necessary for the 
sensation of light the figure is perceived, 


usually inaccurately, with a shape other 


than its true shape. A_ particular 
“wrong” response, however, is frequently 
given with great consistency (2, 12). 
There are, of course, intervening stages 
in this sequence of events, but for the 
sake of convenience it is sufficient to 
regard it as a three-stage process re- 
ferring thus to light threshold, threshold 
for indefinite form, and threshold for 
definite form. 

In order to account for data of this 
nature at the neurophysiological level, 
a recent paper (2) has proposed a “dif- 
fusion” hypothesis based upon the now 
well-known satiation theory of Kohler 
and Wallach (16), originally put for- 
ward to interpret figural aftereffect data. 
An important objection to such an hy- 
pothesis can be found in the lack of cor- 
respondence between the alleged diffu- 
sion and satiation processes and the es- 
tablished evidence regarding neuro- 
physiological events at the cortex. Dis- 


satisfaction arising from this inconsist- 
ency has led recently (21) to a reinter- 
pretation of the figural aftereffect in 
terms of a more orthodox theory of cor- 
tical activity.. This reinterpretation, 
which has its origins in the work of 
Marshall and Talbot (19), has as its 
central notion a cortical representation 
of a perceived contour in the form of a 
Gaussian distribution of neural excita- 
tion in area 17. This view, which will 
be referred to here as the statistical 
theory, is in sharp contrast to the first, 
which employs the notion of a potential 
difference between cortical areas of dif- 
ferent ionic concentration giving rise 
to a flow of current about the cortical 
representation of a contour. 

The same objections which led to an 
alternative interpretation of the figural 
aftereffect underlie the present attempt 
to account neurophysiologically for the 
phenomena of form perception outlined 
above. It is almost a truism to state 
that any hypothesis that seeks a rela- 
tionship between subjective phenomena 
and central processes should take into 
consideration, as far as possible, what 
has been established regarding the na- 
ture of cortical and subcortical activity. 
The aim of this analysis will be, then, 
to interpret form-perception phenom- 
ena occurring at a near threshold con- 
trast in terms of the statistical theory. 
If this can be achieved successfully, the 

1 Smith (24) has raised a number of objec- 
tions to an interpretation of the figural after- 
effect using the statistical theory (21). These 
objections apply only, however, to the use of 
this theory in relation to the figural aftereffect, 
and do not raise controversial issues in the 
application of this theory to the data treated 
here. 
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the figure passes through a number of 
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than its true shape. A particular 
“wrong” response, however, is frequently 
given with great consistency (2, 12). 
There are, of course, intervening stages 
in this sequence of events, but for the 
sake of convenience it is sufficient to 
regard it as a three-stage process re- 
ferring thus to light threshold, threshold 
for indefinite form, and threshold for 
definite form. 

In order to account for data of this 
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a recent paper (2) has proposed a “dif- 
fusion” hypothesis based upon the now 
well-known satiation theory of Kohler 
and Wallach (16), originally put for- 
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An important objection to such an hy- 
pothesis can be found in the lack of cor- 
respondence between the alleged diffu- 
sion and satiation processes and the es- 
tablished evidence regarding neuro- 
physiological events at the cortex. Dis- 


satisfaction arising from this inconsist- 
ency has led recently (21) to a reinter- 
pretation of the figural aftereffect in 
terms of a more orthodox theory of cor- 
tical activity.1 This reinterpretation, 
which has its origins in the work of 
Marshall and Talbot (19), has as its 
central notion a cortical representation 
of a perceived contour in the form of a 
Gaussian distribution of neural excita- 
tion in area 17. This view, which will 
be referred to here as the statistical 
theory, is in sharp contrast to the first, 
which employs the notion of a potential 
difference between cortical areas of dif- 
ferent ionic concentration giving rise 
to a flow of current about the cortical 
representation of a contour. 

The same objections which led to an 
alternative interpretation of the figural 
aftereffect underlie the present attempt 
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interests of parsimony will have been 
served and the way cleared, perhaps, 
for a neurophysiological approach to 
more complex data of visual perception. 


THE STATISTICAL THEORY 


The statistical theory, as originally 
conceived of by Marshall and Talbot 
(19), deals with certain aspects of vis- 
ual resolution from a neurophysiological 
viewpoint. Examination of a consider- 
able body of neurophysiological, ana- 
tomical, and subjective evidence has led 
to a general theory of sensory acuity in 
its various forms (vernier, hairline, bar 
resolution), pattern illusions and depth 
discrimination. The theory has broken 
away from the classical interpretation 
of acuity in terms of the behavior of 
single receptors, and employs the notion 
of populations of neural elements be- 
having in a statistical fashion. The 


statistical theory emphasizes at the same 
time the role of the postretinal system. 


Visual acuity and contour recognition 
are functions attributable largely to the 
visual cortex and its associated systems. 

Central to the theory is the concept 
of lateral and vertical summation. The 
former occurs across cells at the same 
neural level as, for instance, between 
bipolars, whereas vertical summation 
takes place between one neural level and 
another higher in the projection system, 
e.g., between receptors and bipolars and, 
presumably, between bipolar and gang- 
lion elements. Lateral summation oc- 
curs most markedly in the periphery, 
although this process is by no means 
confined to this region. Thus Marshall 
and Talbot state, “The difference be- 
tween central and peripheral organiza- 
tion is, even in this respect, merely a 
matter of degree or extensiveness” (19, 
p. 123). Ample evidence for this rela- 
tive difference between foveal and pe- 
ripheral organization has been adduced 
by Polyak (23). Vertical summation 
has its origin in the tendency for neu- 
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rons to be fired, not by stimulation of 
a single contact, but by several impulses 
arriving at one or two contacts within a 
short time interval. 

The principle of reciprocal overlap is 
of considerable importance in the sum- 
mation processes and to the theory as a 
whole. This is described by the authors 
in the following manner: 

A sub-maximal reaction involving only part 
of the available neurons will have the greatest 
reaction density at the center of the reacting 
group. That is, on a numerical basis, more 
contacts are involved there. This results in a 
statistical peaking on the basis of a number of 


elements involved per unit cross-sectional area 
(19, p. 126). 


Two further characteristics of the sys- 
tem are temporal and spatial dispersion 
of the retinal image. Temporal discon- 
tinuity results from certain features of 
the neural recovery cycle which break 
up neural activity, and from closed neu- 
ral circuits which produce still further 
dispersion within the projection system. 
Spatial dispersion is a consequence of 
reciprocal overlap of pathways, some of 
which bear a cellular ratio of 1: 100 
to each other. It is these properties of 
the primary projection system which, 
in the view of the authors, has necessi- 
tated a reorientation of the classical con- 
ception of isomorphic relations between 
receptor cells and cortex.” 

Still further complexities are intro- 
duced by muscular and optical proper- 


2In critically discussing the statistical the- 
ory, Byram (3) has stated that the proposals 
of this theory would demand a process analo- 
gous to that which would be involved in ob- 
taining a sharp enlargement from a blurred 
photographic negative by manipulating the 
focusing mechanism of the enlarger so as to 
obtain an equal and opposite blur. In view of 
the complexities of the whole visual system, 
there is no reason to suppose that some such 
process could not occur. Indeed, the fineness 
of cortical grain, as compared with that of the 
retina, and the processes of vertical and lateral 
summation and damping within the projection 
system would appear to be suitable for accom- 
plishing this. 
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ties of the eye. Physiological nystag- 
mus produces eye flutter of an ampli- 
tude varying from 2’ (four cones) from 
10 to 100 times per sec. to 30’ (60 
cones) once per sec. In consequence, 
the neural “image” plays continuously 
across the projection area at the cortex. 
Marshall and Talbot describe this 
process: 


Physiologically, irregularly distributed nys- 
tagmus works to refine the image through this 
dynamic averaging process, without necessarily 
invoking the aid of neural recovery cycle be- 
havior. A fine line oscillating over 4 or 5 
rows of receptors would, even under equilibra- 
tion conditions, produce a center of gravity 
through the action of partially shifted over- 
lapping connections (19, p. 139). 


Aberrations of the pupil, especially 
that of diffraction, cause a blurredness 
of the retinal image, so that there occurs 
a near normal distribution of intensity 
at each narrow line or sharp edge. The 
final outcome of these summation and 
dispersive processes within the primary 


projection system and the diffusion of 
the image at the eye is a statistical 
(Gaussian) distribution of excitation at 
the striate cortex. The synthesis of 
these diverse yet closely related activi- 
ties is best described by the authors: 


The neural “image” plays continuously over 
the projection area at every synaptic level, 
building up gradients and peaks of activation 
at every edge and line. This is inherent in 
partially shifted reciprocal overlap. Miultipli- 
cation of path both increases the reciprocal 
overlap and refines the mosaic in proportion 
to the sharper gradients and peaks produced, 
as sand forms sharper peaks than bricks (19, 
p. 139). 


In order to employ this theory in an 
interpretation of the figural aftereffect, 
Osgood and Heyer (21) have made six 
further assumptions. Some of these are 
merely more clearly specified assump- 
tions already implicit in the theory; 
others are extra to the original formula- 
tion of the theory. Here only those 
further assumptions that are necessary 
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in dealing with form-perception data will 
be restated. The first assumption is a 
clarification of the notion of normal dis- 
tribution of excitation at the cortex; the 
second is less implicit in Marshall and 
Talbot’s paper, but would appear to be 
required for their theory; and the third 
and sixth assumptions have been made 
for the purpose of treating the figural 
aftereffect. These last two are neces- 
sary also for an interpretation of form 
perception data. 

1. The representation of a contour 
in the projection cortex (area 17) is a 
normal distribution of excitation, sym- 
metrical about its axis transversely, and 
extending as a “ridge” throughout the 
longitudinal extent of the contour. 

2. “On-off type” fibers and their cen- 
tral connections are chiefly responsible 
for the distributions of excitation in area 
17, which represent visual forms, lines, 
and contours. 

3. The rate of excitation of the mech- 
anisms responsible for contour percep- 
tion will vary directly with (a) their 
nearness to intensity gradients on the 
retina, and (b) the sharpness of such 
intensity gradients. 

6. The apparent localization of a con- 
tour in subjective visual space coincides 
with the location of maximal excitation 
in area 17. 


THE STATISTICAL THEORY AND FoRM 
PERCEPTION 


It is now possible to link together the 
phenomenological reports of form per- 
ception with which this paper began and 
the statistical theory of neurophysio- 
logical activity in the visual system. 
During the first perceptual stage, that 
of an awareness of light, where contrast 
is low, and usually after the observer 
has been subjected to a period of dark 
adaptation (2, 5, 12), lateral summation 
would predominate and vertical summa- 
tion would be at a minimum. It will be 
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recalled that Marshall and Talbot have 
indicated that differences with respect 
to foveal and peripheral relations be- 
tween receptors, their bipolars, and 
ganglion cells are mainly a matter of 
degree, so that lateral summation doubt- 
less occurs under the conditions of 
foveal viewing at low brightness. In 
the absence of a strong vertical compo- 
nent, statistical peaking of the excita- 
tion of distribution will be less marked 
than under conditions of greater bright- 
ness contrast. In consequence, the nor- 
mal distribution of activity in area 17 
will be flattened or platykurtic, since 
both the slope of the excitation gradient 
and the height of the distribution rep- 
resenting rate of excitation about the 
cortical locus of the contour edge will 
be slight. The probable nature of this 
distribution at the light threshold is 
shown in Fig. la. The form of the 
distribution follows from assumption 3 
above, which states that the rate of ex- 
citation is dependent upon the nearness 
and sharpness of intensity gradients. 
Since intensity is low at this stage, and 
since the gradient is far from sharp, 
retinal and higher-level excitation will 
be weak. 

At this point it seems reasonable to 
modify assumption 6 above, in order to 
take into account form perception at 
low brightnesses, with which Osgood 
and Heyer’s analysis was not concerned. 
This is to the effect that (6a) the ap- 
parent localization of a contour in sub- 
jective visual space coincides with the 
location of maximal excitation in area 
17 when the slope and height of the ex- 
citation gradient exceeds a certain mini- 
mum value. The slight slope and flat- 
tened distribution shown in Fig. 1a is not 
such as to permit contour localization, 
since the effective maximum excitation 
extends across a relatively wide band. 
The curve does not rise sufficiently 
sharply to delineate an edge between 
the two regions of different brightness. 
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Marshall and Talbot have stated the 
possibility that the perception of light 
as contrasted with that of form is medi- 
ated by a separate system (19, p. 131). 
Here the “on-type” or “X-type” (9) 
ganglion fibers would be likely to main- 
tain a succession of impulses during con- 
tinuous photic stimulation, serving to 
evaluate brilliance over larger areas and 
serving probably an essentially proto- 
pathic function. As is characteristic of 
protopathic sensibility, there is an all- 
or-none response with no grading of the 
response (22), as would be required for 
the perception of form. Also, during 
this initial perceptual stage when the 
“on-type” fibers are presumably active 
in the absence of clear edge or contour, 
it would be likely that neural accommo- 
dation processes (13) would lead to a 
raising of the threshold for firing of 
those groups of cells most actively en- 
gaged, i.e., those at the center of the 
distribution, resulting in still further 
flattening of the excitation distribution. 
Thus there is a stage (light threshold) 
in form perception, under the conditions 
being considered here, at which borders 
and edges are not perceived, and prob- 
ably at which vision is essentially proto- 
pathic rather than epicritic. The extent 
of excitation at this stage would be such 
as to produce a response to light, al- 
though (because of the flattened and 
unpeaked distribution) insufficient for 
even the vaguest hint of contour. 
Within the context of the above argu- 
ment may well be found the answer as 
to what is perceived first—light without 
form, or light with circular form. The 
historic but unresolved controversy (11, 
12, 26) concerning whether the initial 
perception of light possesses or does not 
possess form qualities has never been 
satisfactorily concluded. It seems rea- 
sonable to suggest, in the light of the 
preceding discussion, that the formless 
impression of light is an earlier percep- 
tual stage than that of the impression of 
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light with circular form. ..The first 
would be cortically represented by a 
less steep gradient and a more flattened 
excitation distribution than the second 
impression, which would occur later in 
the perceptual process. The appearance 
of light with circular form could also 
occur when increments in the contrast 
between figure and surround are of 
greater magnitude, so that the formless 
light stage would be left out of the se- 
quence of perceptual events. 

Increasing the brightness of a figure 
to about 15 times that required for the 
perception of light results in the impres- 
sion of vague and indefinite form. At 
this stage it has been shown (2, 12) 
that the observer tends to mistake fairly 
consistently the shape of the stimulus 
figure reporting a square as a circle, an 
H-shape as a square or butterfly, and 
an L-shape as a triangle or semicircle. 
Since at this stage the brightness of the 
figure has increased, to give greater con- 
trast it would be expected that the ver- 
tical component of the summation proc- 
ess would play a more active role. In 
consequence, the slope of the excitation 
distribution will become steeper, and the 
form of the distribution less flattened. 
As a result of clearer differentiation of 
figure and ground, there will occur an 
increase in the degree of nystagmatic 
flutter across the still ill-defined edges. 
Subjective reports indicate that the 
slope and height of the excitation curve 
is now at, or just above, the minimum 
required for the localization of edges 
and borders, but insufficiently in excess 
to attribute definite form qualities to 
the stimulus figure. As will be shown 
later, attentive processes probably play 
an important part between this stage 
and that of the emergence of definite 
form. 

The final phase of form perception is 
the emergence of a clearly outlined and 
definite shape. This stage is represented 
cortically by a further development of 


Fic. 1. The distribution of cortical excita- 
tion about the edge between stimulus figure 
and surround at the three stages of form 
perception. 


those processes occurring during the sec- 
ond stage. The slope of the excitation 
gradient and the height of the distribu- 
tion of activity will increase stili more, 
and further peaking of the distribution 
will be revealed in greater sharpening 
of the activity peak. The sharpness of 
the edges of the figure concomitant upon 
still greater figure-ground contrast will 
lead to more nystagmatic oscillation, 
and the activity of the “on-off type” 
fibers will be increased. This stage is 
shown in Fig. Ic. 

The part played by attention in the 
determination of the form threshold has 
been stressed by Marshall and Talbot: 


The gradients constructed from the image do 
not define activity until they encounter some 
ultimate threshold, which transects the peaks 
and gradients of activity. This would allow 
for subvisible neural action leaving traces in 
memory. . . . This threshold level, moreover, 
may be controllable within limits by the ob- 
server, and be the physiological effector of 
attention. . . . This local control of threshold 
would be “driven” by the effort to complete 
the pattern, initiated at a higher synaptic level 
(19, p. 141). 

Attention processes conceivably act by ma- 
nipulating thresholds at some synaptic level. 
One can imagine a process in which the at- 
tention mechanisms seek out the peaks or 
gradients, literally trying to fit the various 
patterns, to determine which pattern can be 
seen with minimum effort (19, p. 150). 


The 


importance of attention in 
manipulating threshold, and its signifi- 
cance in the total perceptual process, 
has been emphasized also by Hebb (10) 
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and Bartlett (1). Hebb has discussed 
in detail the role of attention in percep- 
tion, referring it to a partly autonomous, 
or nonsensory cerebral activity; and 
from the subjective viewpoint Bartlett 
has stressed the process of “effort after 
meaning” which appears to be essen- 
tially the same notion as that introduced 
by Marshall and Talbot. 


APPLICATION OF THE STATISTICAL 
HyporTHeEsis TO SoME Form- 
PERCEPTION DATA 


Emergence of form. Bitterman, 
Krauskopf, and Hochberg (2) used nine 
geometric forms; circle, square, dia- 
mond, equilateral triangle, cross, and L, 
X, T and H shapes, each with an area 
of .25 sq. in. In addition a diamond 
and an X shape equal in area to 1.00 
sq. in. were used. Each observer was 
dark adapted for 10 minutes, and then 
shown the figures illuminated for .5 sec. 
every 2 sec. against a dark ground. At 
the indefinite form stage the square was 
called a circle, the triangle a circle, the 
cross a diamond, the X a square, the T 
a triangle with apex down, the L a semi- 
circle or half-moon shape, and the H 
was sometimes reported as a butterfly 
shape. The circle was rarely perceived 
as anything but a circle. On methodo- 
logical grounds, only a single threshold 
determination was made for each form. 
Helson and Fehrer (12) measured foveal 
thresholds for six figures of equal area; 
triangle, rectangle, square, semicircle 
and angle (L shape). In this experi- 
ment, determination of threshold in 
terms of intensity of illumination was 
made by the method of adjustment, so 
that time of exposure was not controlled. 
Essentially the same results as those 
obtained by Bitterman ef al. are re- 
ported, although there are occasional 
differences as to which shapes were per- 
ceived at the threshold for indefinite 
form. 
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In order to interpret these data using 
the statistical theory, the case of the 
cross perceived as a diamond at the 
threshold for indefinite form will be 
taken as an example. It has been 
pointed out that, at the stage of indefi- 
nite form, the distribution of cortical 
excitation about an edge is at, or pos- 
sibly just in excess of, that level re- 
quired for the recognition of contour, 
although the sharpness of the activity 
peak is insufficient to attribute definite 
form qualities to it. Figure 15 shows 
the slightly flattened and unpeaked dis- 
tribution in which the maximum effec- 
tive value (i.e., width of distribution at 
the threshold level) would extend out 
into the angle formed by the intersect- 
ing arms of the cross, thus creating the 
subjective impression of a_ triangle 
rather than that of an open angle. The 
flatness, and hence the greater extent 
of the maximum excitation range, causes 
a “filling in” of the angle so that, taking 
the cross as a whole, the subjective 
appearance will be that of a diamond 
shape rather than that of a cross. 
Further, the “filling in” effect, resulting 
from the relatively wide extent of the 
maximum effective value of the excita- 
tion ridge, will give also the impression 
of blurredness, since the gradient of ex- 
citation represented in the slope of the 
curve falls away gently, failing thus to 
delineate subjectively areas of clearly 
different contrast. Therefore, the spaces 
between edges meeting at an angle will 
be filled in and, under the present con- 
ditions, this filled-in area will shade off 
gradually to give the impression of 
blurring. There will be, in other words, 
a gradation of brightness, from the 
brighter inner region of the angle formed 
by the two edges to the outer region, 
which will be darker than the former, 
and which will shade gradually into the 
dark surround. 

With further increases in the bright- 
ness of the figure, the excitation distri- 
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bution about the cortically represented 
edges will grow peaked as vertical sum- 
mation becomes more prominent, and 
the width of the maximum density of 
activity narrows. The effect of these 
changes in the nature of the cortical 
excitation ridge will be to lessen the 
blurring and the extent of filling in 
about the borders of the cross. This 
stage is represented in Fig. Ic. 

The processes described serve to ex- 
plain the indefinite form stage reports 
of X shape as a square, and the T shape 
as a triangle with apex down. Percep- 
tion of the H shape as a butterfly (2) 
requires further qualification. In an 
earlier experiment (12) this shape was 
reported as a square at the threshold 
for indefinite form. Since there is no 
reason to doubt the accuracy of the sub- 
jective impressions reported by observ- 
ers in the two experiments, it is very 
likely that the “butterfly” and “square” 
reports represent different stages in what 
is a continuous process of the emergence 
of definite form. The butterfly stage is 
somewhere intermediate between that of 
a square and definite form. Bitterman 
et al. (2) have been careful to point out 
that, in the experiment by Helson and 
Fehrer (12), repeated threshold deter- 
minations were made for each figure, so 
that observers became aware that only 
one of six forms could possibly emerge. 
Such a knowledge of the stimulus figure 
could easily lead to an overlooking of 
the butterfly impression, since observers 
would in their “effort after meaning” 
(1) perceive this as the H. Previous 
knowledge of the figure would lower the 
threshold for its definite form in the 
manner described above (10, 19). The 
same argument applies in the case of 
the indefinite form stage reports of the 
L shape as a triangle (12) and as a 
half-moon or semicircular shape (2). 

Most experiments of this nature are 
unanimous in showing that the most 
common indefinite form stage report for 
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the square is that of a circle, although 
this particular “wrong” response occurs 
in only about 10 per cent of the re- 
sponses (12). This percentage of 
wrong responses is much less than that 
found, say, for an angle which is in the 
vicinity of 40 per cent. The blurring 
effect, resulting from the flattened or 
nonpeaked excitation distribution de- 
scribed above, would account for such 
responses. It is noteworthy that squares 
and rectangular figures have a consist- 
ently low threshold for definite form 
(2, 17) indicating, as would be expected 
from this hypothesis, that the external 
right angles of these figures do not for 
long remain obscured by blurring. In- 
ternal angles formed by indentations 
and protuberances in the outline of the 
figure would be very much more prone 
to filling in and blurring effects. 

The processes described above to ex- 
plain the perception of relatively simple 
geometric shapes probably occur also in 
relation to very much more complex 
figures. Before the threshold for defi- 
nite form has been attained, complex 
silhouette pictures are erroneously per- 
ceived (5) so that the silhouette of a 
ship at sea is perceived as “a dog with 
a long tail,” and that of yachts at sea 
as “islands with trees.” As would be 
expected with more complex stimulus 
figures, the erroneous reports at the 
threshold for indefinite form tend to be 
less consistent between observers than 
is the case with simple geometric forms. 

Area and area-perimeter ratio. It has 
been shown (2, 7, 17) that large figures 
have a lower threshold for definite form 
than smaller figures. It follows from 
the argument presented here that the 
larger the figure the less will be the fill- 
ing-in effect resulting from the flattened 
excitation curve at the cortex. Presum- 
ably the width of the excitation ridge is 
the same about an edge, no matter what 
the size of the figure. With large and 
small figures of the same perimeter-to- 
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area ratio, figure details in the nature 
of indentations and protuberances would 
be less obscured, as a result of the flat- 
tened distribution, with a large figure 
than would be the case with a small 
figure of the same shape. 

Threshold for definite form is affected 
also by the ratio of perimeter to area 
(2, 14, 17). The greater the perimeter 
of a figure in relation to area (i.e., the 
greater the P/A ratio) the greater will 
be the detail in the outline of the figure 
and thus the more complex the form. 
In terms of the present hypothesis, edge 
detail such as notches, indentations, ser- 
rations, and projections would be more 
subject to obscuring in the manner 
outlined for the open angle of a cross. 
This would result in a higher threshold 
for figures of greater P/A ratio than for 
figures of the same area but smaller P/A 
values. Although no data are available, 
the present hypothesis suggests that the 
greater the P/A ratio the greater will be 
the inconsistency of wrong responses at 
the threshold for indefinite form. 

Important evidence relating to the 
effect of magnitude of detail on form 
threshold has been collected by Fry 
(7), who used fine and coarse saw-tooth 
edges between areas of different bright- 
ness. Contrast values for definite form 
were found for four patterns of the same 
over-all length, but in which the num- 
ber of teeth varied from 2 to 16 and in 
which the visual angle subtended by 
one segment of the pattern varied from 
83’ to 10.4’. With the finest pattern 
(16 teeth) two thresholds were found; 
one at which the saw-tooth contour was 
perceived as a straight line (indefinite 
form) and a second at which individual 
saw-teeth were visible (definite form). 
With the three coarser patterns only one 
threshold was observed, i.e., individual 
saw teeth were visible wherever the con- 
tour was visible at all. Since these ex- 
periments were carried out under normal 
lighting conditions, this latter result 
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would be expected from the present 
hypothesis. That is to say, since the 
brightness of one edge relative to the 
other was increased from a level at 
which vertical summation would in all 
probability be active, the edges would 
not be blurred to the same extent had 
the eye been dark adapted first and con- 
trast increased from a low initial bright- 
ness. Under these latter conditions a 
wavy edge probably would have preceded 
the appearance of the coarse saw-tooth 
border, since the emergence of definite 
form would be relatively slower. Fry 
obtained essentially the same results 
with fine and coarse wavy line patterns. 
It is interesting to note that these data 
have been interpreted (2) as clearly 
suggesting the operation of a diffusion 
process. The interpretation offered here 
serves equally well in dealing with these 
results, as well as remaining in much 
closer and realistic contact with neuro- 
logical theory. Finally, Marshall and 
Day (18), using a grating test object 
constituted of bars subtending a visual 
angle of 12’, and serrated turret-fashion 
along one edge, have also observed the 
tendency to perceive the border as 
straight during the indefinite form stage. 
Further evidence in support of the sta- 
tistical theory is provided by the above 
data relating to the perception of saw- 
tooth, wavy line, and serrated edges. 
The tendency to perceive these edges as 
straight at low contrast is a result of 
the blurring and obscuring of fine de- 
tail arising from an extended and flat- 
tened distribution of cortical excitation. 


CONCLUSIONS 


The arguments presented here are 
tentative, and in many respects specu- 
lative, yet they offer a consistent theory 
of form perception as an alternative to 
the diffusion hypothesis, which lacks 


neurophysiological foundation. The 
theory from which these arguments have 
been derived, although itself speculative 
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to a certain degree, is based firmly upon 
neurophysiological and anatomical facts. 
It also has the less important but 
nevertheless relevant commendation that 
it has proved fruitful in dealing with 
other aspects of visual form perception 
(21). For the purposes of clear and 
detailed exposition, this paper has been 
confined largely to the treatment of 
form perception at low levels of illumi- 
nation, with increasing contrast between 
figure and ground. The theory can be 
extended, however, to treat further data 
of form perception closely related to the 
data dealt with here. For instance, there 
is now a considerable body of evidence 
(4, 6, 8, 15, 20, 25, 27) concerning the 
perception of form at varying distances 
from the fovea. 

As the retinal image of the stimulus 
figure is located closer to the fovea, so 
form grows increasingly clear. In much 
the same manner as with foveal pres- 
entation at low illumination, the results 
from investigations employing the cam- 
pimetric technique indicate that percep- 
tion of the figure passes through a num- 
ber of stages before it is perceived 
clearly. Thus Zigler et al. (27) have 
observed four stages: the figureless field, 
formless field, formlike figure, and clear 
figure. The last three of these are prob- 
ably analogous to the three perceptual 
stages observed as the contrast between 
a foveally viewed figure and its sur- 
round is gradually increased. Similarly, 
during the stage preceding that of clear 
perception the same “wrong” responses 
are given frequently, with considerable 
consistency. Since vertical summation 
would be expected to occur to a greater 
degree at retinal loci close to the fovea, 
it follows that edges and contours would 
increase in clarity and definiteness as 
the figure is viewed at decreasing angles 
from the foveal line of regard. With- 
out entering into a detailed analysis of 
peripheral form perception, the avail- 
able evidence does indicate a close 
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agreement between experimental find- 
ings and the present hypothesis. 
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